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1.  INTRODUCTION 


The  United  States  Air  Force  Geophysical  Laboratory  (AFGL)  is 
responsible  for  developing  new  weather  instruments  for  the  Air 
Weather  Service  (AWS) .  This  report  describes  the  evaluation  of 
candidate  visibility  sensors  for  deployment  in  the  Automated 
Observing  System  (AOS)  being  developed  by  AFGL  for  the  AWS.  The 
United  States  Department  of  Transportation  (DOT)  Federal  Aviation 
Administration  (FAA)  has  similar  responsibilities  to  develop 
visibility  sensors  for  civil  aviation.  In  order  to  make  the  best 
use  of  government  resources,  the  DOT  Transportation  Systems 
Center  (TSC)  and  AFGL  have  worked  together  for  many  years  to 
evaluate  visibility  sensors.  Most  of  the  joint  studies  have  used 
the  AFGL  test  site  at  Otis  Air  National  Guard  Base  (ANGB)  on  Cape 
Cod.  TSC's  contributions  to  this  joint  effort  have  been  to 
supply  some  of  the  test  sensors  and  to  develop  an  extensive 
library  of  data  analysis  software. 

The  primary  goal  of  the  visibility  sensor  evaluations  has  been 
to  develop  a  forward  scatter  meter  (FSM)  that  can  be  used  to 
replace  the  transmissomviter  now  used  to  measure  visibility  at 
airports.  The  first  FSM  was  developed  by  AFGL  in  the  early  1970s 
(Reference  1) .  The  FSM  offers  a  number  of  significant  practical 
advantages  over  the  transmissometer : 

(1)  It  can  be  mounted  on  a  simple  post. 

(2)  It  has  a  large  range  of  response  with  consistent 
accuracy. 

i 


(3) 


It  is  relatively  insensitive  to  window  contamination. 


(4)  It  is  insensitive  to  background  light. 

(5)  Relative  calibration  is  possible  at  any  time. 

Possible  disadvantages  of  the  FSM  are: 

(1)  It  has  different  responses  to  different  obstructions  to 
vision. 

(2)  It  uses  a  small  averaging  volume. 

(3)  Absolute  calibration  requires  a  transmissometer . 

FSM  evaluations  have  sought  to  quantify  these  possible 
disadvantages  and  to  find  a  sensor  that  is  stable,  reliable  and 
accurate . 

This  report  evaluates  forward  scatter  meters  manufactured  by 
three  companies:  EG&G  Inc.,  HSS  Inc.  and  Wright  &  Wright  Inc. 

The  evaluation  period  covered  17  months  (December  1983  through 
April  1985).  During  the  first  6  months  of  this  period  TSC 
evaluated  a  number  of  other  visibility  sensors  (Reference  2)  for 
the  FAA .  The  methodology  developed  for  that  evaluation  will  be 
adopted  for  the  present  analysis.  Because  the  FAA  operates  two 
different  visibility  systems,  the  analysis  was  designed  to 
consider  sensor  performance  for  both  systems.  Since  the  FAA 
terminology  will  be  used  in  this  report,  the  FAA  systems  will  be 
briefly  defined.  The  FAA  Automated  Weather  Observing  System 
(AWOS)  measures  visibility  from  1/4  to  5  miles.  The  FAA  Runway 
Visual  Range  (RVR)  System  measures  RVR  between  150  and  6000  feet. 

Visibility  is  a  function  of  three  variables: 

(1)  The  observer 
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(2) 


The  atmosphere 


(3)  The  object  being  viewed 

A  visibility  sensor  does  not  measure  visibility  directly;  it 
measures  only  the  extinction  coefficient,  which  is  used  to 
characterize  the  atmosphere.  Standard  equations,  based  on 
visibility  research,  are  then  used  to  estimate  the  visibility  for 
a  standard  observer  and  a  specified  object.  The  two  types  of 
visibility  sensor,  transmissometer s  and  scatter  meters,  obtain 
the  extinction  coefficient  by  different  methods,  as  will  be 
described  in  the  following  sections. 

1.1  Transmissometer 

The  transmissometer  consists  of  a  projector  producing  a  light 
beam  which  is  measured  at  a  distance  b  (the  baseline)  by  a 
detector.  When  the  atmosphere  is  clear,  the  detector  is  set  to 
read  100  percent  transmission  (or  near  100  percent  to  account  for 
slight  losses  from  atmospheric  scattering) .  When  the  visibility 
is  reduced,  light  will  be  scattered  from  the  beam  and  the 
measured  transmission  will  be  less  than  100  percent.  The 
relationship  between  transnission  T  and  extinction  coefficient 
(sigma)  is  given  by  the  eqiation: 

T  =  exp(-c’b)  .  (1) 

The  transmissometer  give:,  good  readings  when  a  sizable  fraction 
of  the  beam  is  scattered  out,  but  is  susceptible  to  error  when 
only  a  small  portion  of  the  beam  is  scattered.  In  the  latter 
case,  the  scattering  loss  can  be  obscured  by  window  losses,  lamp 
drift  or  background  light.  The  transmissometer  becomes  saturated 
when  most  of  the  light  is  scattered  out  of  the 


beam  (T  less  than  1  percent).  Thus,  the  total  range  of 
extinction  coefficients  which  can  be  accurately  measured  by  a 
single  transmissometer  is  only  a  factor  of  ten.  Frequent  window 
cleaning  is  needed  to  maintain  transmissometer  accuracy. 

In  the  transmissometer,  the  light  beam  and  detector  field  of 
view  must  both  be  well  collimated  so  that  light  scattered  out  of 
the  beam  is  not  detected.  Thus,  the  transmissometer  requires 
rigid  towers  and  foundations  to  maintain  alignment  of  the  narrow 
beams. 

Perhaps  the  primary  feature  of  the  transmissometer  which 
allowed  it  to  be  readily  accepted  is  that  it  is  self-calibrating 
as  described  above.  Unfortunately,  this  feature  also  represents 
a  practical  problem;  recalibration  is  impossible  if  a 
transmissometer  fails  during  a  period  of  reduced  visibility. 

1.2  Scatter  Meter 

A  scatter  meter  operates  on  the  opposite  principle  from  the 
transmissometer.  Instead  of  measuring  the  light  remaining  in  a 
beam,  the  scatter  meter  measures  the  light  scattered  out  of  the 
beam.  If  a  scatter  meter  detected  all  the  scattered  light,  it 
would  give  the  same  information  as  the  transmissometer,  as  long 
as  the  particles  in  the  atmosphere  do  not  absorb  light  (which  is 
normally  the  case) .  Since  a  practical  scatter  meter  cannot 
collect  all  the  scattered  light,  a  compromise  is  adopted  where 
light  scattered  only  in  the  forward  direction  (perhaps  20  to  40 
degrees  scattering  angle)  is  collected.  Such  an  instrument  is 
termed  a  forward  scatter  meter.  This  range  of  scattering  angles 
provides  a  signal  for  fog  that  is  reasonably  proportional  to  the 
total  extinction  coefficient  even  when  the  fog  droplet  size 
varies.  Some  variations  are  noted,  however,  for  other 
obstructions  to  vision. 
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The  forward  scatter  meter  is  not  self-calibrating.  Its  output 
must  be  compared  to  that  of  a  transmissometer  to  obtain  an 
absolute  calibration.  In  practice,  the  calibration  is  obtained 
by  comparing  the  slope  of  the  response  for  the  two  sensors  for  a 
number  of  fog  events  and  adopting  a  mean  calibration  factor  which 
relates  FSM  output  to  extinction  coefficient.  Once  one  unit  of  a 
particular  FSM  design  has  been  calibrated  against  a 
transmissometer,  a  transfer  calibration  can  be  defined  for  other 
similar  units.  An  artificial  scatterer  or  "calibrator"  is  placed 
in  the  scattering  region  and  the  sensor  output  voltage  noted. 
(Since  a  solid  object  will  scatter  much  more  strongly  than  fog, 
the  calibrator  must  also  attenuate  the  scattered  signal  in  order 
to  avoid  saturating  the  sensor  detector.)  Another  sensor  can  be 
calibrated  by  installing  the  calibrator  and  adjusting  the  gain  to 
give  the  same  output  voltage.  In  order  for  this  method  to  be 
practical,  the  calibrated  scatterer  must  be  (1)  uniform  spatially 
so  that  it  represents  the  scattering  obtained  from  fog  and  (2) 
stable  in  time  so  that  the  calibration  voltage  does  not  drift. 

A  satisfactory  calibrator  is  required  before  forward  scatter 
meters  can  be  maintained  in  the  field.  Since  such  a  calibrator 
can  be  used  on  a  work  bench  even  more  easily  than  in  the  field, 
it  is  possible  to  keep  a  spare  calibrated  FSM  which  can  be 
deployed  whenever  a  field  unit  fails. 


2 .  TEST  CONFIGURATION 


The  Tasker  RVR-500  transmissometer  is  currently  deployed  at 
airports  on  a  250-foot  baseline  to  measure  Runway  Visual  Range 
(RVR)  values  between  approximately  600  and  6000  feet.  The  system 
consists  of  a  projector,  a  receiver  and  a  computer.  The  beam  of 
light  from  the  projector  is  intercepted  by  the  receiver,  the 
light  pulses  counted  in  the  computer  and  converted  to  a 
visibility  value.  The  presence  of  fog  or  other  material  which 
reduces  the  visibility  along  the  path  of  the  beam  diminishes  the 
detected  light  intensity  proportionately,  while  any  light  from 
sources  external  to  the  beam  which  is  scattered  into  the  receiver 
will  increase  the  apparent  RVR.  Tr ansmissometers  generally  are 
expensive,  difficult  to  maintain  in  a  properly  aligned  condition, 
and  limited  in  response  below  600  feet  RVR,  which  corresponds  to 
Category  Illb  landing  conditions. 


In  these  investigations,  a  series  of  four  Tasker  RVR-500 
transmissometer s  with  baselines  of  approximately  1000,  500,  300 
and  40  feet  are  used  as  standards  for  comparison  of  the  FSM 
responses.  Details  of  the  FSMs  tested  are  given  in  the  following 
sections . 


HSS  Inc.  VR-301  Forward  Scatter  Meter 


The  HSS  forward  scatter  meter  consists  of  horizontal 
transmitter  and  receiver  beams  intersecting  at  a  scattering  angle 
of  about  30  degrees.  The  light  source  is  a  light-emitting  diode 
modulated  at  3000  Hertz.  The  sample  volume  is  defined  by  the 
intersection  of  the  transmitted  beam  of  light  and  the  ray-cone 
which  defines  the  field  of  view  of  the  receiver  system,  as  shown 
in  Figure  2-1  below.  The  scattering  volume  is  very  small, 
approximately  400  cubic  centimeters.  Specifications  of  the  VR- 
301  are  given  in  Table  2-1. 


FIGURE  2-1.  OPTICAL  SCHEMATIC  OF  THE  VR-301  VISIBILITY  METER 


TABLE  2-1.  SPECIFICATIONS  OF  THE  VR-301  FSM 


PERFORMANCE  CHARACTERISTICS 


The  performance  characteristics  stated  below  are  based  on  a 
time  constant  of  30  seconds  for  the  electronic  circuitry  of  the  VR- 
301  and  the  ability  of  the  readout  or  recording  system  to  cover  the 
full  output  signal  range  (0  to  10  volts)  of  the  VR-301  with 
appropriate  resolution. 


Visual  Range  Coverage  (Note  1) 

X  .1  Gain  Setting 
X  1  Gain  Setting 

RMS  Noise  Voltage  (At  Output) 

Night  time 
Day  time 

Linear  Dynamic  Range 
Stability  of  Zero  Setting 

Ambient  Temperature  Effects 
Long  Term  Drift 

Measurement  Error  (Std.  dev.) 

(Includes  All  Calibration  and 


3  m  to  30  km 
30  m  to  300  km 

<1  millivolt 
<2  millivolts 

104  to  1 

^2  millivolts 
<.2  millivolts 

<.+  5% 

Instrumental  Errors) 


Maintenance 


MTBF 

Calibration  Check 
Clean  Windows 


INSTRUMENT  CHARACTERISTICS 

Analog  Output,  proportional  to  the  scattering 
coef  f ic ient 


5.9  years 
Every  3  months 
Every  3  months 


0  to  10  Volts 


Scattering  Angle  Coverage 
Sample  Volume 


270  to  420 
400  cm3 


Measurement  Time  Constant 


30  sec 


TABLE  2-1.  SPECIFICATIONS  OF  THE  VR-301  FSM  (Cont.) 


Spectral  Features: 

Central  Wavelength 
Bandwidth 

Source  Characteristics 

Type 

Lifetime 

Modulation  Frequency 
Detector 


Physical  Characteristics  (VR-301) 

Weight 

Length 


Physical  Characteristics  (Auxiliary  Control  Unit) 

Weight 

Size 


Power  Requirements 

Basic  Instrument 
No-Dew  Windows 
De-Icer  Heaters 

Environmental 

Temperature 

Altitude 

Weather 

Humidity 


0 .89  u  m 
0.08  u  m 


IRED 

10  years 
3000  Hz 

Hybrid  Si- 

Sensor/ 

Amplifier 


14  pounds 
36  inches 


20  lbs 

16"  L  x  12"  W 
x  6"  H 


4  W 
6  W 
100  W 


-500  to  +500  c 
0  to  10,000  ft 
All  Weather 
5%  to  100% 


Notes: 

iv  isual  range  coverage  can  be  optimizd  for  specific  applications 
by  an  internal  potentiometer  adjustment. 


v.AV.vv: 
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The  F0G-15X  visual  range  meter  is  a  compact  instrument 
designed  for  ease  of  installation,  operation  and  maintenance.  It 
measures  the  atmospheric  forward  scattering  coefficient,  which 
can  be  directly  correlated  to  visual  ranges  from  100  feet  to  9 
miles.  The  F0G-15X  consists  of  a  light  source  and  a 
photodetector  separated  by  approximately  four  feet.  The  light 
source,  a  quartz  halogen  lamp  radiating  in  the  0.4  to  1.1 
micrometer  wavelength  range,  is  designed  to  project  a  cone-shaped 
beam  of  light  over  the  angle  of  8  to  20  degrees  from  the  center 
axis  toward  the  photodetector.  The  silicon  photodetector  looks 
toward  the  light  source  and  is  similarly  configured  to  accept 
light  only  from  a  cone-shaped  volume  of  the  same  dimensions.  The 
resulting  scatter  volume  is  torus-shaped,  with  a  total  volume  of 
0.9  cubic  feet  (25,500  cubic  centimeters). 

Light  energy  scattered  through  a  forward  angle  range  of 
16  to  40  degrees  by  particulates  and  aerosols  in  a  sampling 
volume  is  measured  by  the  photodetector.  This  measurement  is 
linearly  related  to  the  atmospheric  extinction  coefficient,  and 
can  be  correlated  to  visual  range  readings  from  100  to  50,000 
feet.  Light  source  modulation  of  approximately  400  Hz  and 
synchronous  signal  demodulation  effectively  eliminate 
interference  from  background  luminance.  Output  signals  are  low 
impedance  analog  DC  voltages  of  0  to  10  volts  which  are 
transmitted  by  hard  wire  to  the  data  acquisition  system. 

The  light  source  for  the  basic  instrument  is  a  15-watt 
halogen  quartz  lamp.  An  experimental  model,  the  FG50  instrument, 
which  employs  a  higher  intensity  lamp  (5C  watts)  for  improved 
signal  to  noise  performance,  was  also  tested.  Further 
information  on  the  FOG-15X  system  is  given  in  Table  2-2  and  in 
Figure  2-2  and  2-3. 


TABLE  2-2 
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SPECIFICATIONS  OF  THE  FOG-15X  FSM 


Dimensions  of  the  FOG-15X  Visual  Range  Meter  are  shown  in  drawing 
B-2237.  Basic  specifications  of  the  F0G-15X  are  tabulated  below: 

Visual  Rangel:  100  feet  to  9  miles 

Accuracy:  See  Error  Band  Graph,  drawing  A-2168 

Readout:  Standard  -  0  to  +10  VDC  analog  voltage  proportional 

to  integrated  scattering  coefficient,  where  10  volts 
corresponds  to  10-3  cm-l,  or  100  feet  visual  range, 
and  0.01  volts  corresponds  to  10“6  cm-l,  or  100,000 
feet  visual  range. 

Integration  Time  Constant:  27  seconds 
Operating  Temperature  Range:  -20<>C  to  +50°C 


Power:  105-125  VAC,  60  Hz,  single  phase,  300  watts 


2.1.3  EG&G  Inc.  Model  207  Forward  Scatter  Meter 


The  EG&G  Model  207  forward  scatter  meter  was  developed  in 
the  early  1970s  under  Air  Force  support  and  has  been  used 
extensively  in  a  research  mode  for  data  collection.  It  has  a 
large  toroidal  scatter  volume  (about  1.7  cubic  feet  or  48,000 
cubic  centimeters)  and  uses  a  mechanically  chopped  incandescent 
light  source.  Data  from  three  of  these  FSMs  are  included  in  the 
data  analysis.  Specifications  of  the  Model  207,  which  is  no 
longer  in  production,  are  given  in  Table  2-3. 

2 . 2  Test  Standards  and  Site  Layout 

The  reference  standards  used  at  the  Otis  test  site  are 
four  transmissometer s  with  baselines  of  40  feet,  300  feet,  500 
feet  and  1000  feet.  The  300-foot  and  500-foot  baselines  are 
oerpendicular  to  each  other  with  the  sensors  being  evaluated 
installed  in  a  cluster  grouped  near  the  intersection  of  the  two 
baselines.  This  four-baseline  transmissometer  array  provided  a 
visibility  measurement  range  of  50  feet  to  4  miles  allowing 
evaluation  of  sensors  for  both  AWOS  and  RVR  ranges  (see 
Section  1.).  To  maximize  the  availability  of  the  transmissometer 
reference  standards  and  to  ensure  validity  of  the  data,  an 
individual  was  employed  at  the  site  whose  task  waj  to  check  the 
transmi ssometer s  daily,  clean  the  optics  and  recalibrate  the 
units  whenever  atmospheric  conditions  (very  high  visibilities) 
allowed  a  calibration  to  be  performed. 

In  addition  to  the  test  standards,  there  were  nine 
forward  scatter  meters  considered  in  the  analysis,  three  by  each 
of  the  three  manufacturers.  The  HSS  sensors  designated  as  HSS1 
and  HSSA  were  set  up  for  operation  in  the  AWOS  range,  and  the 
sensor  designated  as  HSS 2  covered  the  RVR  range.  The  standard 


TABLE  2-3.  SPECIFICATIONS  OF  THE  EG&G  MODEL  207 


200  feet  to  20,000  feet. 

1.7  cubic  feet  minimum. 

+5%  of  forward  scattered 
coefficient . 

115  vac  +10%,  60  ±5%  single 
phase,  200  watts. 

-30oc  to  +50OC. 

135  pounds. 

Single  pipe  with  optional  guy 
wires . 

Unattended  in  ice,  snow,  rain 
and  similar  hostile 
environments . 

Screw  terminals  behind  access 
cover . 

The  instrument  should  be 
oriented  so  as  to  avoid  direct 
sun  rays  into  the  receiver. 

The  receiver  optics  should  face 
in  a  northerly  direction  when 
used  in  the  Northern 
hemisphere. 


20  sec  nominal 
2  sec  nominal 


Note: 

A  step  change  will  require  several  time  constants  for  the  output 
to  reach  the  steady  state. 


Wright  &  Wright  F0G-15X  sensors  were  designated  as  the  F15A  and 
F15B.  An  experimental  model  with  a  higher  intensity  light  source 
was  designated  as  FG50.  These  sensors  were  intended  to  cover 
both  AWOS  and  RVR  ranges. 

The  EG&G  instruments  were  designated  the  X-l,  X-2  and  Y 
sensors.  These  identical  sensors  also  responded  over  both 
visibility  ranges.  These  sensors  were  also  used  to  provide  a 
zero  reference  for  the  transmissometers  during  subsequent  data 
reduction,  as  explained  later. 

The  work  reported  here  is  a  continuation  of  the  sensor 
evaluation  study  previously  reported  (Reference  2)  which  contains 
the  detailed  test  plan.  For  the  previous  analysis,  sensor  data 
was  collected  between  12/2/83  and  6/20/84.  Subsequent  data 
collection  included  the  nine  forward  scatter  meters  listed  above 
and  the  four  transmissometers.  The  cui rent  analysis  is  based  on 
data  collected  between  1/5/84  and  5/2/85, 

2 . 3  Test  Site  Description 

The  sensor  evaluation  program  was  conducted  at  the 
USAF/Air  Force  Geophysical  Laboratory  (AFGL)  test  facility 
located  at  the  Otis  Air  National  Guard  Base  ( ANGB )  at  Falmouth, 
Massachusetts,  on  Cape  Cod.  This  site  has  the  advantages  of  high 
incidence  of  fog  and  other  adverse  weather  conditions,  the 
availability  of  standard  visibility  measurement  systems,  the 
availability  of  a  data  acquisition  and  recording  facility,  and 
the  presence  of  personnel  experienced  in  conducting  visibility 
sensor  tests  and  in  maintenance  of  the  facility  and  of  the 
visibility  standards. 

The  layout  of  the  visibility  test  site  is  shown  in  Figure 
2-4.  Note  that  all  sensors  except  the  Y  sensor  were  grouped  near 
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FIGURE  2-4.  OTIS  TEST  SITE  LAYOUT 


the  intersection  of  the  300-foot  and  500-foot  transmissoraeter 
paths.  The  Y  sensor  was  located  along  the  path  of  the  1000-foot 
baseline  transmissometer  so  that  it  could  be  used  in  the  100- 
percent  calibration  adjustments  for  this  standard. 

2 . 4  Data  Acquisition 

The  Otis  data  acquisition  system  (DAS)  is  the  USAF 
Modular  Automatic  Weather  System  (MAWS) ,  designed  to  acquire  data 
from  sensors  generating  an  analog  output  voltage.  This  system 
samples  voltage  signals  five  times  per  minute  and  stores  one- 
minute  averages  on  industry  compatible  magnetic  tapes.  All 
sensors  generated  analog  outputs  except  the  reference 
transmissometers ,  which  generate  a  pulse  rate  output  and  required 
a  pulse  to  DC  converter  to  interface  to  the  DAS. 

In  addition  to  recording  test  and  reference  sensor  data, 
the  data  collection  included  the  hourly  weather  observations 
generated  by  the  personnel  of  the  Otis  air  traffic  control  tower, 
located  about  1  mile  from  the  test  site,  and  the  test  site 
records  maintained  by  USAF/AFGL  site  personnel  pertaining  to 
sensor  calibration,  sensor  failures,  repairs,  or  any  observed 
anomalous  sensor  behavior. 

To  further  investigate  the  weather  affecting  the  sensors 
during  low  visibility  episodes,  a  former  Air  Force  meteorologist 
was  provided  as  an  on-site  observer.  During  periods  when  on-site 
observations  were  available,  these  took  precedence  over  weather 
readings  from  the  control  tower. 
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3.  DATA  PROCESSING 


3 . 1  Analysis  Procedures 

Information  from  both  the  forward  scatter  meter  sensors 
and  the  transmissometer  standards  was  collected  at  the  Otis  ANGB 
between  January  1984  and  May  1985  and  recorded  on  magnetic  tape 
for  analysis.  Each  week,  the  site  weather  observations  and 
magnetic  tapes  containing  a  record  for  each  minute  of  data  were 
sent  to  TSC.  Strip  charts  and  performance  files  were  generated 
from  this  raw  data.  Data  was  also  gathered  for  the  files 
necessary  for  further  analysis  with  the  SENSOR  program  (see 
Section  3.6).  Prior  to  compilation  of  the  final  file  of 
extinction  coefficients  (sigma),  the  data  was  normalized  to 
calibrate,  in  effect,  all  of  the  instruments  during  a  single 
event . 


The  sensor  data  was  processed  on  a  Digital  Equipment 
Corporation  (DEC)  PDP-11/23  computer  using  the  RT-11  operating 
system.  The  TSC  computer  program  062  was  used  to  prepare  a  data 
file  of  extinction  coefficients.  Each  extinction  coefficient 
file  ("performance  file"),  approximately  1.2  megabytes  in  length, 
contained  seven  days'  worth  of  data,  with  an  averaging  time  of 
one  minute.  Each  record  included  the  date,  time,  and  a  sigma 
value  for  each  test  and  reference  sensor  at  the  Otis  site.  Only 
13  sensors  were  used  in  this  analysis,  although  data  from  as  many 
as  58  sensors  can  be  analyzed  at  the  same  time. 

In  addition  to  generating  the  performance  files,  the 
program  produces  a  continous  strip  chart  of  the  sensor  sigma 
values  arranged  side-by-side,  to  be  used  for  visual  inspection  of 
the  data.  A  sample  of  the  beginning  of  a  typical  strip  chart  is 
shown  in  Figure  3-1.  Several  features  of  the  chart  should  be 
noted : 
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(1) 


The  straight  vertical  line,  which  starts  as  the 
second  line  from  the  right,  is  an  indication  of 
failure  of  the  sensor,  F15B,  since  it  does  not 
respond  to  the  increasing  sigma  values  seen  by  the 
other  sensors. 

(2)  Approximately  once  each  hour,  the  transmitter  for 
each  transmissometer  is  turned  off  for  about  a 
minute,  so  that  the  receiver  measures  only  the  stray 
light  which  is  scattered  into  it.  The  minimum  value 
of  the  voltage  measured  corresponds  to  a  background 
value,  which  is  subtracted  from  all  normal  readings 
until  the  next  background  check.  This  is  shown  by 
the  horizontal  sections  where  the  readings  of  all 
four  transmissometer s  are  greatly  reduced.  The 
length  of  time  that  the  background  value  is 
displayed  is  increased  by  the  computer  program,  so 
as  to  eliminate  any  transient  effects  due  to  turning 
the  transmitter  off  and  on. 

(3)  The  degree  of  agreement  of  the  FSMs  and  the 
transmissometer s  is  seen  from  the  degrees  that  the 
lines  are  equidistant,  parallel  to  each  other,  and 
show  the  same  series  of  changes  in  sigma  value. 


p  The  scale  on  the  strip  chart  is  a  complex  superposition 

« 

'•  of  linear  and  logarithmic  scales  for  all  13  sensors.  This  is 

■*  shown  in  Figure  3-2,  which  assumes  for  simplicity  that  there  are 

!  only  four  sensors.  Although  a  reading  of  sigma  values  from  the 

>  strip  charts  cannot  be  made  accurately,  the  charts  provide  a 

|  valuable  tool  to  compare  the  response  of  the  instruments  to 

I  changing  weather  conditions  on  a  temporal  basis. 
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Assuming  four  sensors,  the  strip  chart  scale : 


The  performance  file  is  used  as  the  data  source  for 
generating  scatter  plots  with  TSC  computer  program  PHRX.  These 
plots  compare  any  designated  pair  of  sensors  over  a  selected  time 
interval.  For  instance,  to  investigate  the  behavior  of  the 
instruments  during  a  fog  episode  {which  results  in  reduced 
visibility  or  increased  sigma  values) ,  a  scatter  plot  compares 
the  responses  of  the  instruments  and  plots  a  point  on  the  curve 
for  each  one-minute  interval.  If  the  two  sensors  had  completely 
identical  responses,  the  points  would  all  lie  on  a  straight  line 
at  a  45°  angle  and  pass  through  the  point  of  origin.  Adjustments 
to  either  or  both  slope  and  intercepts  of  the  line  can  be  made  as 
an  input  to  the  program  to  show  what  the  effect  would  be  of 
changing  the  calibration  or  bias  values  of  the  instrument. 

A  typical  scatter  plot  is  shown  in  Figure  3-3.  Note  the 
following  features  from  this  plot: 

(1)  The  two  dashed  lines  represent  variations  of  +15% 
from  the  perfect  45°  line. 

(2)  The  fact  that  the  bulk  of  the  points  lie  in  a  line 
which  has  a  slope  of  greater  than  1.0  indicates  that 
the  HSSA  sensor  is  somewhat  more  responsive  to  this 
reduced  visibility  event  than  the  transmissometer . 

(3)  Regardless  of  what  portion  of  the  sigma  range  is 
displayed,  the  program  performs  a  statistical 
analysis  of  all  data  with  sigmas  between  0.060  and 
450,  with  the  break  points  at  0.345,  0.760,1.27, 

3.80  and  50.0.  For  each  range  in  which  there  are 
data  points,  the  program  determines  the  best 
straight  line  through  the  points  using  a  least- 
squares  analysis,  and  presents  this  in  terms  of  the 
slope  of  the  line  and  the  intercepts  on  both  X  and  Y 


axes,  with  the  average  sigma  values,  and  the 
correlation  coefficient  and  residual  standard 
deviation  (RSD)  of  the  line.  The  RSD  is  also 
expressed  as  a  fraction  of  the  test  sensor  sigma, 
which  produces  values  relatively  independent  of  the 
value  of  sigma. 

(d)  Good  agreement  in  the  representation  of  an  incident 
of  low  visibility  by  two  sensors  is  represented  by 
high  values  of  correlation  coefficient,  perhaps 
0.99,  and  low  values  of  fractional  residual  standard 
deviation  (FRSD) ,  on  the  order  of  0.1  or  below. 

3 . 2  Normalization 

Although  all  of  the  test  sensors  were  calibrated  prior  to 
the  initial  test  program  at  Otis  ANGB ,  investigation  of  scatter 
plots  from  early  incidents  of  poor  visibility  showed  clearly  that 
there  was  a  discrepancy  between  the  readings  of  the  test  sensors 
and  those  of  the  transmissometer s .  This  discrepancy  could  have 
been  due  either  to  drift  of  the  calibrations  since  the  time  of 
installation,  or  to  inaccuracies  in  programming  the  conversions 
between  sensor  output  voltage  and  extinction  coefficients.  To 
correct  these  discrepancies,  data  for  the  sensors  was  normalized, 
so  that,  for  a  given  calibration  event,  they  all  showed  the  same 
response  to  fog  as  the  500-foot  baseline  transmissometer. 


No  corrections  were  made  for  the  offset  values.  Since 
the  test  sensors,  all  forward  scatter  meters,  tend  to  have  more 
stable  zero  extinction  coefficient  values  than  the 
transmissometers ,  any  shift  in  the  zero  values  during  the  period 
of  testing  is  normally  associated  with  drifts  in  the 
transmissometer  100-percent  calibration.  Such  transmissometer 
errors  are  corrected  with  the  calibration  file  in  program  SENSOR 
(see  next  section) .  All  calibration  constants  were  adjusted 
according  to  vendors'  instructions  prior  to  start  of  the  test 
period.  For  further  details  on  the  normalization  procedure,  see 
Appendix  A. 

3 . 3  Calibration  File 

Calibration  files  are  produced  to  provide  a  means  for 
relatively  continuous  offset  calibration  adjustment  for  the 
transmissometers.  This  is  done  by  comparing  the  transmissometer 
readings  with  measurements  made  by  the  EG&G  forward  scatter 
meters.  A  properly  operating  FSM  will  have  very  small  offset 
errors.  Previous  investigations  indicated  that,  for  scatter 
plots  of  FSM  against  transmissometer,  a  slope  of  about  1.4  is 
observed  under  high  visibility  conditions.  The  intercept  on  the 
X-axis  (FSM  extinction  coefficient  =  0)  is  used  as  an  offset 
value  to  correct  for  the  calibration  drifts  of  the 
transmissometers.  For  further  details  on  the  formation  of  the 
calibration  file,  see  Appendix  B. 

3 . 4  Failure  File 

The  failure  file  is  intended  to  provide  a  record 
indicating  when  each  of  the  sensors  or  transmissometers  is  not 
operating  correctly.  When  the  SENSOR  program  is  run,  data  is 
bypassed  during  periods  when  any  of  the  sensors  involved  in  a 
study  is  in  failure  mode.  Determination  of  the  operational 


status  of  the  sensors  is  done  by  studying  the  strip  charts.  When 
necessary  and  available,  additional  information  from  the  site 
logs  may  be  used  to  assist  in  identifying  the  failure  periods. 

For  further  details  on  the  preparation  of  the  failure  file,  see 
Appendix  C. 

3 . 5  Weather  File 

Weather  files  are  determined  from  detailed  lists  of 
weather  variations  as  compiled  by  the  on-site  weather  observer  at 
Otis  ANGB.  For  periods  during  which  these  compilations  are  not 
available,  the  Federal  Meteorological  Forms  1-10  (Surface  Weather 
Observations)  from  the  Otis  control  tower  have  been  used. 

Table  3-1  lists  the  14  categories  of  weather  conditions 
which  were  considered  in  the  sensor  test  analysis,  with  the  codes 
corresponding  to  each  category.  Only  one  of  these  14  conditions 
can  occur  at  any  time.  When  a  change  is  made  from  one  weather 
condition  to  another,  a  new  entry  is  made  in  the  veather  file, 
which  both  terminates  the  old  condition  and  starts  the  new 
condition. 

Meteorologists  use  many  other  symbols  to  indicate 
categories  of  weather  which  are  not  considered  separately  in  this 
analysis.  For  instance,  a  following  the  letter  code  normally 

indicates  light  intensity,  while  "+"  indicates  heavy  intensity. 
Both  symbols  are  disregarded  here.  Other  symbols  and  the 
assumptions  which  have  been  made  in  setting  up  the  weather  file 
are  given  in  Table  3-2.  Combinations  not  listed  in  either  table 
are  treated  in  a  similar  manner.  For  further  details  on  the 
preparation  of  the  weather  file,  see  Appendix  D. 


TABLE  3-1.  WEATHER  CONDITIONS  USED  IN  SENSOR  ANALYSIS 


Weather 

Letter 

Numerical 

Condition 

Code 

Code 

[clear 

C 

01 

[other 

0 

01 

Haze 

H 

02 

Fog 

F 

03 

Dr i zzle 

D  or  L 

04 

Rain 

R 

05 

Snow 

S 

06 

Ice  Pellets 

I  or  IP 

07 

Rain  &  Fog 

RF 

08 

Rain  &  Ice 

RI 

09 

Snow  &  Fog 

SF 

10 

Rain  &  Snow 

RS 

11 

Snow  &  Ice 

SI 

12 

Snow  Grains 

SG 

13 

TABLE  3-2.  ADDITIONAL  WEATHER  CONDITIONS 


Weather 

Condition 

Letter 

Symbol 

Treat 

As : 

Rain  Showers 

RW 

Rain 

Snow  Showers 

SW 

Snow 

Blowing  Snow 

BS 

Snow 

Freezing  Drizzle 

ZD 

Drizzle 

Freezing  Rain 

ZR 

Rain 

Snow  Pellets 

SP 

Snow 

Thunderstorms 

T 

Rain 

Fog  &  Haze 

FH 

Fog 

Haze  &  Fog 

HF 

Haze 

Snow  &  Haze 

SH 

Snow  &  Fog 

Rain  &  Snow  &  Fog 

Ice  Pellets  &  Snow 

RSF 

Snow  &  Fog 

&  Fog 

ISF 

Snow  &  Ice 

Ice  &  Fog 

IF 

Ice  Pellets 

Rain  &  Ice  &  Fog 

Rain  &  Snow  &  Ice 

RIF 

Rain  &  Ice 

&  Fog 

RSIF 

Rain  &  Ice 

Rain  &  Drizzle  &  Fog 

RDF 

Rain  &  Fog 
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SENSOR  Analysis  Program 

The  SENSOR  analysis  program  was  developed  to  evaluate 
sensor  performance  as  measured  during  the  field  testing  of  the 
forward  scatter  meters.  The  primary  input  is  the  one-minute 
average  extinction  coefficient  file  (performance  file)  which  is 
produced  by  running  the  062  program  on  the  weekly  field  test 
data.  In  addition,  the  calibration,  failure  and  weather  files 
discussed  previously,  are  inputs  to  this  program. 

Four  performance  files,  covering  a  4-week  test  period, 
can  be  analyzed  at  one  time.  The  analysis  ignores  periods  when 
the  failure  file  indicates  that  either  the  sensor  or  a  necessary 
transmissometer  standard  is  in  failure  mode.  Analysis  is  also 
bypassed  during  periods  when  the  transmissometer s  are  in  their 
background  mode.  The  calibration  file  is  used  to  provide 
corrections  to  the  measured  transmissometer  sigmas  to  account  for 
the  drift  of  the  instruments.  The  weather  file  is  used  to 
establish  which  of  the  14  defined  weather  conditions  exists 
during  the  period  of  the  data  record. 

For  analyses  of  both  the  RVR  and  AWOS  range  responses, 
data  is  included  in  the  analysis  only  if  the  obstruction  to 
visibility  is  considered  uniform  throughout  the  test  region.  The 
criterion  for  uniformity  is  that  the  sigma  values  for  the 
300-foot  and  500-foot  transmissometers ,  which  are  crossed  halfway 
along  their  baselines,  agree  within  10%.  For  each  sigma 
interval,  a  record  is  kept  of  the  number  of  data  points  rejected 
by  this  criterion  compared  to  those  accepted.  For  AWOS 
evaluations,  a  further  requirement  is  that  independent  10-minute 
average  extinction  coefficients  are  used  for  the  analysis.  Only 
those  10-minuto  averages  with  a  minimum  of  5  valid  one-minute 
sigma  values  are  included  in  the  evaluation. 


To  determine  the  acceptability  of  a  FSM  sensor  for  use 
over  the  AWOS  range,  the  standard  used  for  comparison  is  the 
1000-foot  baseline  transmissometer .  The  visibility  range  for 
AWOS  sensors  is  broken  into  18  reporting  increments  (RI)  as  shown 
in  Table  3-3,  which  shows  the  actual  ranges  of  visibility  and 
sigma  values  covered  by  each  RI.  The  RI  are  defined  by  the 
daytime  visibility  equation.  Accuracy  statistics  for  AWOS 
sensors  are  given  in  terms  of  the  number  of  RI  differences 
between  the  sensor  and  the  standard  transmissometer.  The  SENSOR 
program  produces  output  tables  based  on  the  RI . 

For  each  four  weeks  of  data,  the  AWOS  Detail  Tables 
consist  of  120  tables  for  combinations  of  8  sensors  x  15  weather 
conditions  (14  types  plus  All-Weather,  the  sum  of  all  14  types). 
Each  table  shows  the  number  of  data  points  (10-minute  average 
sigmas)  in  each  slot  of  an  18  x  18  matrix  of  the  sensor  RI  values 
against  the  standard  RI  values.  The  AWOS  Summary  Tables,  which 
are  cumulative  throughout  the  entire  60-week  test  period,  consist 
of  the  same  120  tables.  The  RI  values  have  been  combined  into 
four  summary  ranges  (as  shown  in  Table  3-3) ,  and  for  each  range, 
the  number  of  data  points  with  errors  of  ^  1RI ,  >  1RI ,  >  2RI ,  and 
>  4RI ,  as  well  as  the  total  number  of  samples,  are  shown  in  a 
4x5  matrix.  For  samples  of  the  SENSOR  output  tables,  see 
Reference  2. 

A  similar  arrangement  is  used  for  the  RVR  analysis  done 
by  the  SENSOR  program.  The  standard  used  for  comparison  here  is 
the  average  of  the  two  crossed  transmissometer  sigmas  (300-foot 
and  500-foot  baselines).  However,  for  sigma  values  greater  than 
38  km-l,  the  500-foot  transmissometer  is  out  of  its  measurement 
range,  and  the  standard  is  switched  to  the  40-foot  baseline 
transmissometer.  The  one-minute  average  sigma  values  are  broken 
down  into  seven  ranges,  as  shown  in  Table  3-4,  which  also  shows 
the  equivalent  day  time  visibility  ranges.  Accuracy  statistics 


TABLE  3-3.  AWOS  RANGE  REPORTING  INCREMENTS  USED  IN  SENSOR  PROGRAM 


R.I. 

Number 

Visibility 

Label 

Visibility 
Range,  Mi. 

Sigma 

Km-1 

Summary 

Range  Number 

1 

<.25 

<0.187 

>9.61 

- 

2 

.25 

0.187-0.375 

9.61-4.81 

1 

3 

.50 

0.375-0.625 

4.81-2.88 

1 

4 

.75 

0.625-0.875 

2.88-2.06 

1 

5 

1.00 

0.875-1.125 

2.06-1.60 

1 

6 

1.25 

1.125-1.375 

1.60-1.31 

2 

7 

1.50 

1.375-1.625 

1.31-1.11 

2 

8 

1.75 

1.625-1.875 

1.11-0.96 

2 

9 

2.00 

1.875-2.25 

0.96-0.80 

2 

10 

2.50 

2.25-2.75 

0.80-0.66 

2 

11 

3.00 

2.75-3.25 

0.66-0.55 

3 

12 

3.50 

3.25-3.75 

0.55-0.48 

3 

13 

4.00 

3.75-4.50 

0.48-0.40 

3 

14 

5.00 

4.50-5.50 

0.40-0.33 

3 

15 

6.00 

5.50-6.50 

0.33-0.28 

4 

16 

7.00 

6.50-7.50 

0.28-0.24 

4 

17 

8.00 

7.50-9.00 

0.24-0.20 

4 

18 

>8.00 

>9.00 

<0.20 

- 

TABLE  3-4.  RVR  SIGMA  RANGES  USED  IN  SENSOR  PROGRAM 


Range 

Number 

Sigma 

Ranges,  Km-1 

Visibility 
Ranges,  Feet 

Summary 

Range  Number 

1 

1.5-2. 5 

6500-4000 

1 

2 

2. 5-4.0 

4000-2500 

1 

3 

4. 0-7.0 

2500-1400 

2 

4 

7.0-11.0 

1400-900 

2 

5 

11.0-20.0 

900-500 

3 

6 

20.0-38.0 

500-250 

3 

7 

38.0-350.0 

250-30 

4* 

for  RVR  sensors  are  calculated  in  terms  of  values  of  the  ratio  of 
the  sensor  sigma  to  the  standard  sigma. 

For  each  four  weeks  of  data,  the  SENSOR  program  produces 
the  RVR  Detail  Tables,  a  series  of  120  tables  for  combinations  of 
8  sensor  x  15  weather  conditions  (14  types  plus  all-weather). 

Each  table  shows  the  number  of  one-minute  average  data  points  in 
each  of  seven  sigma  ranges  and  nine  ranges  of  the  ratio  of 
sensor/standard  sigma.  The  ratio  ranges  a  e  given  in  Table  3-5, 
which  also  shows  the  relationship  to  the  RVR  Summary  error 
ranges.  The  RVR  Summary  Tables,  which  are  cumulative  throughout 
the  entire  60-week  test  period,  consist  of  the  same  120  tables. 
The  sigma  ranges  have  been  combined  into  four  summary  ranges,  the 
last  of  which  is  only  for  the  all-weather  category,  and  for  each 
range,  the  total  number  of  samples,  the  number  with  >  16.5% 
error,  >25%,  >35%,  and  >  2X  error,  are  shown  in  a  3  x  5 

matrix.  For  samples  of  the  SENSOR  output  tables,  see 
Reference  2. 

The  complete  analysis  using  the  SENSOR  program  consists 
of  15  sets  of  output,  each  covering  a  4-week  data  period. 

Further  summarization  and  analysis  of  the  data  presented  in  the 
SENSOR  outputs  are  included  in  Section  4  of  this  report. 

3.7  Sensor  Calibrations 


One  of  the  objectives  of  the  original  sensor  evaluation 
tests  was  to  insure  that  the  FSM  could  be  operated  automatically 
and  unattended  with  very  infrequent  maintenance  required.  In 
this  regard,  the  sensors  tested  were  to  operate  for  90  days  after 
the  start  of  the  test  period  without  any  changes  in  calibration, 
maintenance,  or  cleaning  of  the  optical  systems.  At  this  point, 
the  manufacturers  were  allowed  to  recalibrate  and  perform 
maintenance  on  their  instruments.  The  test  then  continued  for 


Ratio 

Number 

Ratio 

Label 

Ratio 

Range 

Summary 

Range  Number* 

1 

0.000 

0.000-0.500 

jjpfppjpjHB 

2 

0.500 

0.500-0.750 

12  3 

3 

0.750 

0.750-0.800 

1  2 

4 

0.800 

0.800-0.835 

1 

5 

0.835 

0.835-1.165 

6 

1.165 

1.165-1.250 

1 

7 

1.250 

1.250-1.350 

1  2 

8 

1.350 

1.350-2.000 

12  3 

9 

2.000 

>  2.000 

hbbhii 

♦Range  1  =  >16.5% 

Range  2  =  >25%  (actually  +25%  or  -20%) 
Range  3  =  >35%  (actually  +35%  or  -25%) 
Range  4  =  >  2X 
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another  90  days  with  no  further  work  on  the  instruments.  During 
these  two  test  periods,  the  stability  of  the  FSMs  was  checked  by 
periodically  measuring  the  drift  in  the  zero  and  calibrate 
voltages.  When  the  6-month  period  was  completed,  more  frequent 
maintenance  was  performed.  Calibration  measurements  were  made 
both  before  and  after  each  cleaning  of  the  windows. 

The  calibration  data  has  been  plotted  in  Figures  3-4  for 
each  of  the  nine  sensors  involved  in  this  study.  The  two  curves 
present  the  zero  level  and  the  scale  factor  (difference  between 
calibrate  and  zero  voltages)  for  each  sensor.  Data  from  two 
calibration  filters  is  shown  for  the  HSSl  and  HSS2  sensors,  with 
a  horizontal  offset  between  the  two  sets  of  data  to  increase 
readability.  Only  a  single  calibration  filter  was  used  with  the 
other  sensors.  Scale  factor  variations  are  shown  as  percentage 
changes  from  the  initial  scale  factor  voltage.  Vertical  steps  on 
the  scatter  plot  correspond  to  window  cleaning,  with  the  lower 
value  occurring  prior  to  cleaning.  These  steps  are  most 
pronounced  on  the  HSS  sensors.  The  zero  drift  is  also  shown  as 
the  change  from  the  initial  value,  expressed  in  terms  of  the 
extinction  coefficient  response  of  each  sensor.  The  EG&G  sensors 
were  replaced  whenever  problems  developed.  For  each  of  the  three 
sensors,  three  instruments  were  used  during  the  test  period.  New 
initial  values  of  zero  level  and  scale  factor  were  established 
after  each  change. 
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FIGURE  3-4.  SENSOR  CALIBRATION  HISTORIES  (HSS1) 
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FIGURE  3-4.  SENSOR  CALIBRATION  HISTORIES  (HSSA)  (Cont 
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FIGURE  3-4.  SENSOR  CALIBRATION  HIST01 


FIGURE  3-4.  SENSOR  CALIBRATION  HISTORIES  (I 
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4 .  RESULTS 


The  analysis  of  test  data  used  two  different  approaches: 
1)  Detailed  analysis  of  selected  events  and  2)  Statistical 
analysis  of  all  data.  Weather  information  from  Otis  Air  National 
Guard  Base  and  the  strip  charts  showing  sensor  response  as  a 
function  of  time  were  compared  to  choose  a  series  of  low 
visibility  incidents  which  were  investigated  in  detail  (Sections 

4.1  through  4.3).  The  statistical  analysis,  which  considered  all 
of  the  data  rather  than  just  a  few  incidents,  first  compared  the 
responses  of  the  300-foot  and  500-foot  baseline  transmissometers 
(Section  4.4)  before  comparing  each  sensor  to  the  "standard" 
transmissometer  (Sections  4.5  through  4.7). 

4 . 1  Low  Visibility  Periods 

4.1.1  Otis  Weather  Data 


A  review  was  made  of  all  the  available  Surface  Weather 
Observations  (Form  MFl-10)  from  the  Otis  Air  National  Guard  Base 
to  identify  suitable  low  visibility  periods  for  analysis.  The 
minimum  value  of  surface  visibility  recorded  during  each  day  is 
listed  in  Table  4-1.  For  minimum  recorded  visibilities  of  less 
than  one  mile,  the  times  in  GMT  (subtract  five  hours  to  get 
Eastern  Standard  Time)  during  which  visibilities  were  one  mile  or 
below  are  listed.  If  the  minimum  visibility  was  low  enough  for  a 
sufficiently  long  period,  the  incident  was  considered  for 
analysis . 


4.1.2  Strip  Chart  Data 

The  strip  charts  were  also  searched  to  determine  when  low 
visibility  was  observed  by  the  sensors.  For  acceptance  as  a 
genuine  phenomenon,  the  incident  had  to  be  observed  by  the 
transmissometers  as  well  as  most  of  the  FSM  sensors.  Very 
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approximate  values  of  extinction  coefficients  (sigma)  were  also 
read  from  the  strip  charts,  incidents  which  resulted  in  sigma 
values  of  5  or  greater  have  been  listed  in  Table  4-2.  This  table 
also  shows,  for  each  chosen  incident,  a  list  of  the  sensors  which 
were  in  failure  mode  during  this  period,  as  determined  from  the 
Failure  File  described  earlier  (see  Section  3.4)  ,  and  the  weather 
types  which  were  predominant,  as  determined  from  the  Weather  File 
(see  Section  3.5).  The  symbols  used  for  weather  conditions  are 
detailed  at  the  end  of  the  table. 

4.1.3  Selected  Incidents 

The  tables  of  low  visibility  periods  compiled  from  Otis 
weather  data  and  strip  chart  data  were  each  reviewed  to  determine 
potential  incidents  for  investigation.  The  criteria  used  to 
choose  the  final  incidents  included  the  following: 

a)  The  incident  should  have  a  duration  of  at  least 
three  hours,  preferably  more,  so  as  to  insure 
sufficient  points  on  the  scatter  plots  for 
statistical  significance. 

b)  Extinction  coefficient  peaks  should  be  fairly  broad, 
rather  than  sharply  peaked,  i.e.,  the  time  variation 
in  the  extinction  coefficients  should  be  slow. 

c)  The  incident  should  be  observed  by  most  of  the 
forward  scatter  meters  and  transmissometer s . 

d)  A  minimum  of  the  sensors  should  be  in  the  Failure 
File  during  the  incident. 


TABLE  4-2.  OTIS  LOW  VISIBILITY  INCIDENTS 


TABLE  4-2.  OTIS  LOW  VISIBILITY  INCIDENTS  (Cont 


e)  The  incident  should  generally  be  able  to  be 
categorized  by  a  single  weather  type. 

f)  The  maximum  extinction  coefficient  should  be  at 
least  5  km~l.  Exceptions  were  made  to  this, 
especially  so  that  incidents  under  weather 
conditions  other  than  fog  could  be  selected.  Most 
of  the  high  coefficients  are  caused  by  fog. 

g)  Incidents  should  cover  all  portions  of  the  test 
period,  as  evenly  as  possible.  Exceptions  were  made 
to  allow  for  specific  analyses  which  required  data 
covering  a  short  time  frame. 

Using  the  criteria  specified,  a  series  of  60  incidents 
was  selected  for  further  analysis.  The  dates  and  times  of  the 
incidents  selected  are  shown  in  Table  4-3,  which  also  contains 
other  information  on  the  incidents.  The  column  Days  gives  a  day 
number,  starting  with  1/1/84  as  Day  1,  for  plotting  of  time- 
dependent  trends.  The  Average  Wind  Direction  column,  with  values 
of  01-36  corresponding  to  the  36  ten  degree  sectors  used  by  the 
Weather  Service,  shows  also  the  time  in  minutes  that  the  wind  was 
from  this  general  direction,  and  the  range  of  wind  directions 
during  the  incident.  Several  direction  values  are  shown  on  a 
line  when  the  wind  direction  changed  during  the  course  of  the 
incident.  The  direction  00,  where  no  range  is  specified, 
indicates  that  the  wind  speed  was  below  the  threshold  of  the 
instrument  so  that  the  wind  direction  has  no  meaning.  The 
weather  types  are  indicated  by  the  same  symbols  used  throughout 
this  report,  as  shown  on  Table  3-3.  Finally,  the  listed 
extinction  coefficients  are  obtained  from  the  scatter-plot 
analysis — the  average  value  computed  for  the  T500  trans- 
missometer  for  all  the  data,  and  the  estimated  maximum  value  from 
the  scatter  plot  itself. 
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TABLE  4-3.  SELECTED  LOW  VISIBILITY  INCIDENTS  (Cont.) 


Detailed  analysis  was  done  on  each  of  the  60  selected 
incidents.  The  full  data  set  for  each  incident  included  detailed 
weather  listings,  strip  charts,  and  scatter  plots  for  all  sensors 
plotted  against  the  T500  transmissometer . 


Short  Term  Variations 


Sensor 


The  scatter  plot  program  calculates  the  slope  and 
intercept  of  the  least  squares  line  through  the  scatter-points 
for  several  ranges  of  sigma.  In  general,  the  slope  indicates  the 
ratio  of  the  responses  of  the  two  instruments  over  that  range, 
while  the  intercept  would  indicate  zero  offsets  between  the 
instruments.  A  study  of  how  the  slopes  vary  with  time  should 
therefore  be  indicative  of  how  the  calibration  of  the  FSM  sensor 
changes  with  time  relative  to  the  transmissometer.  Normally,  the 
full  range  of  data  is  used  for  this  analysis. 


Among  the  60  incidents  of  low  visibility  chosen  for 
analysis,  there  are  two  sequences  of  incidents,  each  consisting 
of  four  consecutive  days  with  a  pure  fog  event.  These  are 
incidents  #21-24  (6/30-7/3/84)  and  #30-33  (8/12-15/84).  The 
first  of  these  sequences  is  particularly  attractive,  since  it 
starts  only  four  days  after  the  second  normalization  period,  at 
which  time  all  of  the  full  sigma  range  slopes  were  set  to  1.0. 
Scatter  plots  for  each  of  the  eight  incidents  compared  each  FSM 
Sensor  and  the  T300  transmissometer  to  the  T500  transmissometer. 
Additional  scatter  plots  were  run  for  the  first  sequence, 
comparing  the  FSMs  to  each  other.  The  scatter  plots  for  the  HSS1 
sensor  compared  to  the  T500  transmissometer  for  each  of  the  eight 
incidents  are  given  in  Appendix  E,  which  also  includes  scatter 
plots  for  the  HSSA  sensor  compared  to  the  HSS1  sensor  for  the 
first  sequence  of  incidents.  The  slopes  of  the  scatter  plots  are 
presented  in  Table  4-4  and  4-5,  for  sequence  1  and  2 
respectively.  The  slope  was  taken  from  the  calculation  for  the 


TABLE  4-4.  SCATTER  PLOT  DATA  -  EPISODE  1  (Based  on  6/26/84  Normalization) 


FISA  vs  XI  995  0619  0  958  .996  .0971  0.945  999  .0302  0.989  999  .0428  [1.019 


TABLE  4-5.  OTIS  SCATTER  PLOT  DATA  -  EPISODE  2  (Based  on  6/26/84  Normalization) 


incidents  is  identified  by  the  calendar  dates,  the  time  period 
and  the  day  number  starting  with  1/1/84.  The  subsequent  values 
in  the  table  represent  the  percent  change  in  the  slope  from  1.0, 
the  value  at  the  normalization  times. 

It  should  be  noted  that  correlation  coefficients  and 
residual  standard  deviations  were  also  checked  for  these 
incidents.  In  almost  all  cases  the  data  (not  presented  here)  is 
not  as  well  correlated  as  that  for  the  two  episodes  shown  in 
Tables  4-4  and  4-5.  All  of  the  incidents  are  included  to  get  as 
many  points  as  possible  in  the  subsequent  figures.  The  scatter 
in  the  slopes  was  not  significantly  improved  by  eliminating 
incidents  with  poor  correlation. 

A  plot  of  percent  change  in  slope  as  a  function  of  time 
for  the  HSSl  sensor  is  presented  in  Figure  4-1.  The  complete  set 
of  10  Figures  for  all  the  sensors  is  given  in  Appendix  F.  The 
percent  changes  plotted  are  those  between  +  40  percent, 
corresponding  to  slopes  of  0.60-1.40.  Larger  changes  are 
indicated  by  a  small  arrow  at  the  edge  of  the  plot  with  the  value 
that  cannot  be  plotted  shown  at  the  arrow.  As  can  be  seen  from 
Table  4-6,  several  of  the  Figures  show  more  than  one  slope  change 
greater  than  40  percent.  The  results  show  clearly  that  the 
instability  of  slopes  noticed  for  the  two  episodes  discussed 
previously  is  not  an  isolated  effect.  There  is  no  evidence  of 
any  trend  or  drift  in  calibration  of  any  of  the  instruments.  In 
each  case,  a  horizontal  line  at  zero  percent  error  would  be  a 
reasonable  representation  of  the  data.  There  is  no  indication 
that  choosing  different  normalization  incidents,  or  more 
normalization  incidents,  would  have  any  major  effect  on  these 
findings.  The  T300  vs.  T500  plot  (see  Figure  F-10)  shows  that 
the  T300  response  is  approximately  6  percent  low  compared  to  the 
T500.  On  the  other  hand,  the  F15B,  X-2  and  Y  sensors  all  appear 
to  be  on  the  positive  side  compared  to  the  T500.  The  others  show 
points  reasonably  well  centered  around  zero  percent  change  in 
slope . 
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SLOPES  OF  HSS1  VS  T500  SCATTER  PLOTS  FOR  FOG  EVENTS 

FULL  o  RANGE 


IGURE  4-1.  TIME  VARIATION  OF  HSSl  SCATTER  PLOT  SLOPES  FOR  FULL  SIGMA  RANGE 


The  sensitivity  of  the  scatter-plot  slope  plots  to  the 
selected  range  of  extinction  coefficients  was  investigated.  It 
has  been  noted  that  the  scatter  plots  often  show  quite  different 
slopes  when  only  a  portion  of  the  range  of  sigma  is  investigated. 
Since  some  of  the  sensors  were  intended  for  the  RVR  range  and 
some  for  the  AWOS  range,  it  might  be  expected  that  plotting  the 


slopes  for  partial  sigma  ranges  could  have  an  effect.  The  range 
of  sigma  from  3.8  to  50  km“l  (200-2500  feet  visibility)  roughly 
corresponds  to  the  RVR  range,  and  sigmas  from  0.06  to  3.8  km-l 
(0.5-30  miles  visibility)  to  that  of  the  AWOS  range. 

The  analysis  of  slopes  for  the  RVR  range,  similar  to  that 
provided  for  the  overall  sigma  range,  is  presented  in  Table  4-7. 
The  plot  for  the  HSSl  sensor  is  in  Figure  4-2,  and  the  complete 
set  of  10  plots  is  given  in  Appendix  G.  Similarly,  for  the  AWOS 
range,  data  is  contained  in  Table  4-8,  Figure  4-3,  and  Appendix 
H.  It  is  evident  from  all  of  these  plots  that  the  same  general 
comments  apply  for  the  partial  sigma  range  data  that  were  noted 
for  the  full  range  data.  There  is  considerable  variation  in  the 
slope  changes,  perhaps  even  larger  for  the  partial  ranges,  and  no 
trends  can  be  established.  The  scatter  of  the  points  might  be 
expected  to  increase  because  slopes  are  obtained  from  fewer 
points  for  the  partial  ranges,  and  in  some  cases  the  slopes  are 
not  statistically  significant. 

For  some  of  the  incidents  studied,  it  appeared  that  the 
scatter  plots  for  sensors  of  a  similar  kind  were  more  in 
agreement  with  each  other  than  with  the  transmissometer .  An 
additional  set  of  comparisons  was  done  tracing  the  ratios  of 
scatter  plot  slopes  of  similar  sensors  as  a  function  of  time. 

The  data  is  directly  obtained  from  the  previously  presented 
slopes,  i.e.,  the  ratio  of  slopes  HSS2/HSS1  is  obtained  from  the 
slope  HSS2/T500  divided  by  slope  HSS1/T500.  The  analysis  is 
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SLOPES  OF  HSS1  VS  T500  SCATTER  PLOTS  FOR  FOG  EVENTS 
a  RANGE  3.80  TO  50.0  Knrv1 


FIGURE  4-2.  TIME  VARIATION  OF  HSS1  SCATTER  PLOT  SLOPES  FOR  RVR  RANGE 


TABLE  4-8.  SCATTER  PLOT  SLOPES  FOR  AWOS  RANGE  -  FOG  EVENTS 

(Sigma  =  0.06-3.80) 
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presented  in  Table  4-9  and  a  plot  of  the  HSS2/HSS1  ratios  for  the 
full  sigma  range  is  given  in  Figure  4-4.  The  complete  set  of 
nine  plots  is  given  in  Appendix  I.  Comparing  these  plots  to  the 
full  sigma  range  plots  for  individual  sensors  measured  against 
the  transmissometer  (the  scales  are  identical)  ,  there  is  a 
definite  reduction  of  the  spread  of  the  points. 

In  addition  to  the  attempt  to  correlate  the  data  when 
slopes  which  had  low  correlation  coefficients  and/or  high 
residual  standard  deviations  were  eliminated,  mentioned  above, 
several  other  comparisons  were  made.  In  one  attempt,  slopes  from 
all  of  the  60  incidents  were  plotted,  rather  than  just  the  41 
pure  fog  events.  In  general,  the  curves  did  not  change  much, 
despite  the  fact  that  the  other  weather  conditions  were  added, 
although  for  several  sensors  the  scatter  did  seem  to  increase 
somewhat.  In  another  attempt,  the  average  wind  directions  for 
each  incident  were  superimposed  on  the  fog  event  plot,  to  see 
whether  any  consistent  pattern  of  specific  wind  directions 
corresponding  to  large  slope  changes  could  be  discovered.  This 
was  hampered  by  the  number  of  occurrences  of  wind  speeds  below 
the  instrument  threshhold,  which  made  the  direction  readings 
meaningless.  No  general  trend  was  observed.  Finally,  the 
average  sigma  values  during  each  incident  were  superimposed  on 
the  fog  event  plot,  to  see  whether  any  correlation  was  possible 
between  high  or  low  sigmas  and  the  changes  in  slopes.  Again,  no 
relationship  was  apparent.  Since  none  of  these  attempts 
individually  had  any  significant  effect  on  the  plots,  this  data 
is  not  presented  here. 


Finally,  to  aid  in  understanding  the  physical  processes 
which  were  involved  in  cases  of  large  slope  changes,  such 
incidents  were  investigated  in  more  detail  for  the  EG&G  sensors. 
Of  the  three  FSM  sensor  types,  the  EG&G  units  showed  the  most 
consistent  slope  relationships  with  the  transmissometer.  In 
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TABLE  4-9.  SCATTER  PLOT  SLOPE  RATIOS  FOR  SIMILAR  SENSORS  -  FOG  EVENTS 

(Sigma  =  0.60-50.0) 


RATIO  OF  SCATTER  PLOT  SLOPES  HSS2/HSS1  FOR  FOG  EVENTS 

FULL  a  RANGE 
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Table  4-6  and  Figures  F-7  and  F-8  of  Appendix  F,  for  the  X-l  and 
X-2  sensors,  respectively,  only  five  fog  events  (5,  12,  15,  16, 

17  for  X-l  and  7,  12,  14,  15,  17  for  X-2)  gave  slope  errors  of 
more  than  15  percent.  Three  of  the  events  (12,  15  and  17)  were 
the  same  for  both  sensors.  Such  slope  errors  represent  serious 
disagreements  between  the  FSM  and  the  transmissometer  for  the 
obstruction  to  vision,  namely  fog,  for  which  the  FSMs  were 
calibrated.  Therefore,  it  is  important  to  understand  the 
conditions  when  such  errors  occur  in  order  to  assess  the 
reliability  of  FSM  measurements. 

Two  of  the  large-slope  error  events  were  characterized  by 
relatively  low  extinction  coefficients  (maximum  of  10  and  6  km~^ 
for  Events  12  and  17,  respectively).  These  events  showed 
abnormally  high  slopes.  It  has  been  noted  (References  3  and  4) 
that  FSMs  show  a  higher  slope  (perhaps  1.4)  for  high  visibilities 
(haze)  than  for  fog.  Normally  this  high  slope  region  lies  below 
1.0  km-1  extinction  coefficient.  However,  for  these  two  events 
the  high  slope  region  extended  well  above  1.0  km-l  and  gave  an 
overall  slope  just  above  1.2.  Apparently  these  summer  events  had 
very  high  densities  of  haze  particles.  Future  research  may  allow 
a  nonlinear  FSM  calibration  that  includes  the  effects  of  haze. 

The  relative  humidity  could  be  used  as  a  guide  to  differentiate 
haze  from  fog. 

Two  events  (15  and  16)  for  the  X-l  sensor  showed  a 
nonlinear  response  that  showed  saturation  at  high  extinction 
coefficients  and  hence  gave  low  slopes.  This  sensor  was 
apparently  defective  and  was  shortly  taken  out  of  service. 

For  Event  14  the  extinction  coefficient  went  above  38 
km" 1 ,  so  the  500-foot  transmissometer  saturated  and  gave 
anomalously  high  slopes  for  X-2  (but  not  for  X-l  which  also  had  a 
saturated  response  at  that  time.) 
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!  Event  7  showed  a  large  amount  of  scatter  (fractional 

[residual  standard  deviation  of  0.17)  which  gave  an  abnormally 
high  slope  for  X-2  but  not  X-l.  This  result  represents 
statistical  error. 


Finally,  one  event  for  each  sensor  (5  for  X-l  and  15  for 
X-2)  showed  no  anomalies.  These  cases  had  slope  errors  of  less 
than  20  percent,  low  for  the  X-l  case  and  high  for  the  X-2  case. 
Perhaps  these  cases  represent  momentary  calibration  changes  or 
significantly  different  types  of  fog. 

In  summary,  study  of  the  scatter  plot  slopes  indicates 
that  the  responses  of  each  of  the  sensors  compared  with  the 
transmissometer  show  large  variations  on  a  short-term  basis,  even 
when  the  data  had  just  been  normalized.  The  variations  continued 
through  the  long  term,  but  did  not  get  larger.  No  long  term 
drift  in  calibrations  could  be  observed  in  this  manner. 

Comparison  of  sensors  from  the  same  vendor  showed  some  reduction 
in  the  variations,  which  indicates  that  the  sensors  agree 
somewhat  better  among  themselves  than  with  the  transmissometer. 
Various  mechanisms  have  been  suggested  as  underlying  the  large 
slope  variations  for  the  EG&G  sensors,  which  are  also  applicable 
to  the  other  FSMs . 
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Transmissometer  Agreement 


The  SENSOR  analysis  program,  as  explained  previously, 
processes  the  files  of  extinction  coefficients  with  the  Failure 
File  to  remove  from  consideration  all  entries  where  either  the 
sensor  or  the  appropriate  transmissometer  is  in  failure  mode. 

For  the  RVR  range,  the  remaining  1-minute  average  extinction 
coefficients  are  used  for  analysis.  For  the  AWOS  range,  10- 
minute  average  extinction  coefficients  are  formed  for  each  period 
for  which  at  least  five  valid  coefficients  exist.  In  both 
cases,  the  weather  type  is  selected  from  the  Weather  File  input. 
Fourteen  categories  of  weather  are  used,  plus  an  All-Weather 
grouping.  For  both  RVR  and  AWOS  ranges,  data  is  rejected  if  the 
300-foot  and  500-foot  transmissometer  sigmas  do  not  agree  within 
10  percent,  and  the  analysis  proceeds  on  the  remaining  data. 

Data  on  the  number  of  samples  rejected  ("Bad")  and 
accepted  ("Good")  due  to  this  transmissometer  uniformity 
criterion  are  included  on  each  4-week  summary  SENSOR  output. 

Since  the  two  transmissometer s  occupy  the  same  location  but  are 
crossed  at  right  angles,  this  test  is  intended  to  accept  only 
data  points  measured  under  conditions  of  relative  atmospheric 
uniformity.  It  is  also  of  interest  to  compare  the  response  of 
the  two  transmissometer s  to  see  how  often  these  similar 
instruments  indicate  the  same  extinction  coefficient.  The 
results  of  this  comparison  for  the  RVR  range  are  shown  in  Table 
4-10  for  all-weather  conditions,  for  each  of  the  15  four-week 
analysis  periods.  A  complete  set  of  tables  for  nine  weather 
conditions  and  all-weather  is  included  in  Appendix  J.  The  other 
five  weather  conditions  (ice  pellets,  rain  &  ice,  rain  &  snow, 
snow  &  ice,  and  snow  grains)  have  been  eliminated  from  this 
analysis  as  there  are  not  enough  data  points  to  make  them 
significant,  however  they  are  present  in  the  summary  table. 
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rABLE  4-10.  ALL  WEATHER  DATA  ACCEPTANCE  RATES  FOR  RVR  RANGE 
(Based  on  Crossed  Tr ansmissometer  Agreement  Within  10%) 


TOTAL  13  365  4’  $  1  55  2  12132  3266  60  5  1 1787  3454  6S  9  1 1570  3514  I  69  1  ll193  4189  77  8 1  543  2547  82  4  I  18  1452  98  8 1  10608  22573  68  01 


Since  the  FSM  sensors  are  not  involved  in  this  analysis,  during 
each  period  for  each  weather  condition,  data  from  the  sensor  with 
the  largest  number  of  data  points  was  selected. 

The  RVR  range  results  are  summarized  in  Table  4-11  for 

each  of  the  weather  types  and  ranges  of  extinction  coefficient, 
for  the  full  60-week  test  period.  The  Total  Samples  column  is 

the  sum  of  "#  bad"  and  "#  good,"  and  the  "%  good"  column  is  an 

indication  of  how  often  the  crossed  transmissometer  readings 
agreed  within  10  percent.  The  last  columns  contain  data  for  the 
overall  RVR  range,  and  show  that  transmissometer  agreement  is 
quite  dependent  on  the  weather  type.  For  clarity,  the 
information  is  presented  graphically  in  Figures  4-5.  The  trend, 
clearly  visible  on  the  all-weather  chart,  shows  that  the 
transmissometers  agree  more  closely  as  the  visibility  becomes 
lower.  The  agreement  varies  from  55  percent  for  visibilities  in 
the  vicinity  of  1  mile  to  99  percent  for  visibilities  below  250 
feet,  with  an  overall  average  of  68  percent. 

The  poorer  agreement  at  high  visibility  is  probably  a  consequence 
of  poor  transmissometer  accuracy  which  is  not  completely 
corrected  by  the  transmissometer  calibration  process.  The  high 
agreement  at  low  visibilities  is  not  surprising,  since  for  sigma 
values  above  38  Km-1  the  analysis  makes  use  of  the  single  40-foot 
transmissometer  instead  of  the  crossed  transmissometers  and 
therefore  defines  all  points  as  "good". 
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FIGURE  4-5.  VISIBILITY  DATA  ACCEPTANCE  RATES  FOR  RVR  RANGE  (WEATHER  TYPE 


SIBIL 


IS  I B I 


VISIBILITY  DATA  ACCEPTANCE  RATES 
FOR  RVR  RANGE 
WEATHER  TYPE  -  SNOW 


GCEPTANCE  RATES  FOR  RVR  RANGE  (WEATHER  TYPE  -  SNOW)  (Cont. 


2/2 


MMU7»  17<  OTIS  OHM  (21*  HAT  I  OHM.  SUM'S  BASE)  VISHILITV  SCHSO* 
FIELD  TEST  STUDV<U>  TRANSPORTATION  SYSTEM  CENTER 
CMMtIOOE  IM  D  SCMMRTZ  ET  M.  FEB  B7  AF8L-TR-M-BM1 
UNCLASSIFIED  ESD-3-MC  F/O  4/2 


«*  / 


< 

“  ec 

m  Hi 

u  x 

Zmt 

<o° 

' 

ui  <  UJ 

kjcc  a. 

U 

«§►- 

k-  Hi 

a  O  H 
Q  u.  < 

£  3 


o  o  o  o 

«T  cn  «N  «- 


O  **•  <UUUJO.hluQ  v/i  <  5  a- 


4-43 


5MW 


B5 


tom) 


Similar  comparisons  for  the  AWOS  range  are  shown  in  Table 
4-12  for  the  all-weather  conditions.  The  complete  set  of  tables 
as  listed  above  is  included  in  Appendix  K.  The  AWOS  range 
results  are  summarized  in  Table  4-13,  for  each  of  the  weather 
types  and  ranges  of  extinction  coefficient,  for  the  complete  60- 
week  test  period.  This  information  is  also  presented  graphically 
in  Figures  4-6.  As  in  the  case  of  the  RVR  charts,  the  all- 
weather  and  fog  charts  show  that  the  agreement  between  the  two 
transmissometers  is  better  at  lower  visibilities,  varying  from  32 
percent  for  visibilities  of  7  or  8  miles  up  to  75  percent  for 
visibilities  of  about  half  a  mile.  Note  that  visibilities  of 
greater  than  2  miles  are  considered  to  be  outside  the  range  of 
accuracy  of  these  transmissometers,  so  that  some  of  the  poor 
agreement  could  be  influenced  by  errors  in  the  instruments.  The 
overall  average  agreement  of  45  percent  is  well  below  the  overall 
RVR  average  of  68  percent. 


4 . 5  Ratio  of  Sensor  to  Standard  Readings 

The  analysis  performed  by  the  SENSOR  program  continued 
with  all  of  the  accepted  samples,  signifying  relative  uniformity 
of  the  atmosphere  as  measured  by  crossed  transmissometer 
agreement  within  10  percent.  The  program  compared  the  sensor 
readings  to  the  measurements  taken  with  the  transmissometers, 
used  as  standards.  Which  readings  are  used  as  standards  depends 
on  the  values  of  the  extinction  coefficient.  For  the  RVR  range, 
the  standard  value  is  the  average  of  the  300-foot  and  500-foot 
transmissometers.  However,  when  the  500-foot  transmissometer 
indicates  a  sigma  in  excess  of  38  km~l  (250  feet  visibility  and 
less) ,  these  transmissometers  are  outside  their  normal  range  of 
accuracy,  and  the  standard  is  switched  to  the  40-foot 
transmissometer.  For  the  AWOS  range,  the  standard  is  the  1000- 
foot  transmissometer. 


TABLE  4-12.  ALL  WEATHER  DATA  ACCEPTANCE  RATES  FOR  AWOS  RANGE 
(Based  on  Transmissometer  Agreement  Within  10%) 


TABLE  4-13.  SUMMARY  OF  AWOS  RANGE  DATA  ACCEPTANCE  RATES 
(Based  on  Tr ansmi ssometer  Agreement  Within  10%) 


all  W£ATH£R  3242  32  4  2560  40  0  1735  44  0  1605  48  7  1248  46  0  1051  48  1 


IBILITY  DATA  ACCEPTANCE  RATES  FOR  AWOS  RANGE  (WEATHER  TYPE  -  FOG) 


VISIBILITY  DATA  ACCEPTANCE  RATES 
FOR  RVR  RANGE 
WEATHER  TYPE  -  HAZE 


FIGURE  4-6.  VISIBILITY  DATA  ACCEPTANCE  RATES  FOR  AWOS  RANGE  (WEATHER  TYPE  -  HAZE)  (Cont 
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FIGURE  4-6.  VISIBILITY  DATA  ACCEPTANCE  RATES  FOR  AWOS  RANGE  (WEATHER  TYPE  -  FOG  AND  DRI ZZLE ) (Cont . 
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LITY  DATA  ACCEPTANCE  RATES  FOR  AWOS  RANGE  (WEATHER  TYPE  -  RAIN)  (Cont. 
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FIGURE  4-6.  VISIBILITY  DATA  ACCEPTANCE  RATES  FOR  AWOS  RANGE  (WEATHER  TYPE  -  RAIN  AND  FOG)  (Cont. 


BILITY  DATA  ACCEPTANCE  RATES  FOR  AWOS  RANGE  (WEATHER  TYPE  -  SNOW)  (Cont . 


VISIBILITY  DATA  ACCEPTANCE  RATES 
FOR  RVR  RANGE 

WEATHER  TYPE  -  SNOW  AND  FOG 


FIGURE  4-6.  VISIBILITY  DATA  ACCEPTANCE  RATES  FOR  AWOS  RANGE  (WEATHER  TYPE  -  SNOW  AND  FOG) (Cont 
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FIGURE  4-6.  VISIBILITY  DATA  ACCEPTANCE  RATES  FOR  AWOS  RANGE  (WEATHER  TYPE  -  OTHER)  (Cont. 
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FIGURE  4-6.  VISIBILITY  DATA  ACCEPTANCE  RATES  FOR  AWOS  RANGE  (WEATHER  TYPE  -  ALL  WEATHER) ( 


The  detailed  program  output  for  each  of  the  15  four-week 
time  periods  contains  arrays  of  sensor  data  as  a  function  of  the 
sensor  tested,  ranges  of  the  standard  readings,  and  weather 
types.  The  AWOS  details  are  voluminous  and  are  not  conducive  to 
further  summary.  This  data  will  be  approached  in  a  different 
manner  in  the  next  analysis  (Section  4.6).  The  RVR  details  are 
considered  further  here. 

The  RVR  detail  arrays  consist  of  seven  extinction 
coefficient  ranges  of  the  standard  and  nine  groups  of  ratios  of 
sensor  reading  to  standard  (crossed  tr ansm i ssometer ,  except  for 
the  last  sigma  range)  reading,  with  the  number  of  samples  in  each 
of  these  categories  listed.  The  limits  of  the  ratio  ranges  for 
each  group  number  are  shown  in  Table  4-14  and  have  been 
previously  explained  (see  Section  3.6).  The  first  step  in  the 
summarization  of  this  data  was  to  sum  the  data  for  all  extinction 
coefficients.  When  this  was  completed,  the  data  set  consisted  of 
nine  values  of  the  number  of  samples  in  each  ratio  group  number, 
for  each  weather  type,  for  each  time  period. 

This  data  was  now  rearranged  and  collected  by  weather 
type.  As  in  the  previous  analysis,  five  of  the  weather  types 
(ice  pellets,  rain  &  ice,  rain  &  snow,  snow  &  ice,  and  snow 
grains)  have  been  removed  from  consideration,  since  there  are  not 
enough  cases  to  be  significant.  A  sample  of  the  results  of  this 
consolidation  is  given  in  Table  4-15  for  the  HSS1  and  HSS 2 
sensors  under  Fog  and  Haze  conditions.  The  complete  set  of 
tables  is  given  in  Appendix  L.  Note  that  Haze  conditions  existed 
during  only  a  few  of  the  time  periods.  Further,  the  HSS1  sensor 
was  down  during  time  period  15,  when  the  HSS 2  sensor  indicated 
some  Haze  data.  Two  additional  columns  have  been  included  in 
these  tables.  The  most  probable  value  of  group  number  for  any 
line  of  data  is  simply  the  group  number  which  occurs  most 
frequently.  The  average  group  number  has  been  obtained  by 
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TABLE  4-14.  DESCRIPTION  OF  SENSOR  AVERAGE  GROUP  NUMBERS 

-RVR  RANGE- 


There  are  nine  groups  depending  on  the  ratio  of  the  sensor  reading  to  the  crossed 
_ _ transmissometer  mean  reading 


Group 

No. 


0 

0.50 

0.75 

0.80 

0.835  - 

1.165  - 

1.25 
1.35 

>2.00 


0.50 
0  75 
0.80 
0  835 
1  165 
1  25 
1.35 
2.00 


Relation  to  Error  Limit  Tables 


Group 

Error 

5 

<  16  5% 

4-6 

<25% 

3-7 

<35% 

2-8 

<100% 

The  number  in  each  Group  is  obtained  form  the  SENSOR  output 


Average  Group  #  = 


9 

(M>  in  Group)N  X  N 

_ 

9  ' 

^  (No.  in  Group) 


Time 

Period 


Dates 


01/26/84 
02/23/84 
03/22/84 
04/19/84 
05/17/84 
06/14/84 
07/12/84 
08/09/84 
09/12/84 
10/26/84 
11/23/84 
1 2/20/84 
01/17/85 
02/14/85 
03/14/85 
01/26/84 


02/23/84 
03/22/84 
04/19/84 
05/17/84 
06/14/84 
07/12/84 
08/09/84 
09/12/84 
10/26/84 
1 1/23/84 
12/20/84 
01/17/85 
02/14/85 
03/14/85 
04/1 1/85 
04/1 1/85 


*  Normalization#! 

Incident  of  2/14-2/15/84 

**  Normalization  #2 
Incident  of  6/26/84 

Switched  as  of  6/22/84 


Plot  No 

Sensor 

1 

HSS1 

2 

HSS2 

3 

HSSA 

4 

F15A 

5 

FI  58 

6 

FG50 

7 

X-1 

8 

X  2 
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TABLE  4-15.  COMPARISON  OF  SENSOR  RATIOS  -  RVR  SUMMARY 

(Summed  over  Sigma) 


multiplying  the  number  of  samples  in  each  group  by  the  group 
number,  summing,  and  dividing  by  the  total  number  of  samples. 
Since  the  limits  on  Group  5  are  ratios  from  0.835  to  1.165,  if 
all  of  the  data  lies  in  this  group,  then  the  average  group  number 
is  5.00  and  all  sensor  readings  are  within  16.5  percent  of  the 
standard  readings.  Note,  however,  that  an  average  group  number 
of  5.00  can  also  be  obtained  from  10  samples  in  Group  1  and  10 
samples  in  Group  9,  so  that  a  good  average  group  number  does  not 
necessarily  signify  small  sensor  errors.  This  problem  is 
addressed  by  the  next  analysis,  which  would  show  less  than  16.5 
percent  error  for  the  first  case,  but  greater  than  100  percent 
error  for  the  second  example. 

A  further  consolidation  can  be  made  if  only  the  overall 
time  period  (line  T)  is  considered  for  each  of  the  sensors  and 
weather  conditions.  This  information  is  presented  as  Table  4-16. 
This  allows  a  direct  comparison,  for  each  weather  condition,  of 
the  total  numbers  of  samples  (a  reflection  of  the  down  time  of 
some  of  the  sensors)  and  the  average  group  number.  For  ease  of 
comparison,  this  data  is  also  presented  graphically  in  Figure 
4-7.  Note  that  results  for  weather  conditions  of  fog,  haze,  and 
drizzle  &  fog  show  average  group  numbers  close  to  the  "perfect" 
5.0.  This  is  due,  at  least  in  part,  to  the  fact  that  sensor 
normalizations  were  done  during  periods  of  fog.  Conditions  of 
drizzle,  rain,  and  rain  &  fog  result  in  relatively  high  group 
numbers,  indicating  that  FSMs  are  more  responsive  than  the 
transmissometer s ,  while  snow,  snow  &  fog,  and  other  conditions 
(most  of  these  are  high  visibility  "clear"  conditions)  are  fairly 
consistently  low,  indicating  that  the  FSMs  are  less  responsive 
than  the  transmissometer s .  The  "All-Weather"  chart  indicates 
average  group  numbers  for  all  of  the  sensors  are  between  4  and  6, 
primarily  due  to  the  preponderance  of  fog  conditions  in  the  data 
sample . 
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TABLE  4-16.  COMPARISON  OF  SENSOR  RATIOS  -  RVR  SUMMARY 
(Summed  over  Sigma  and  Time) 
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TABLE  4-16.  COMPARISON  OF  SENSOR  RATIOS  -  RVR  SUMMARY 
(Summed  over  Sigma  and  Time)  (Cont.) 


SL>J* 


COMPARISON  OF  SENSOR  AVERAGE  GROUP  NUMBERS 
FOR  FULL  VISIBILITY  RANGE  (30-6500  FEET) 

RVR  SUMMARY  FOR  FULL  TEST  PERIOD 


COMPARISON  OF  SENSOR  AVERAGE  GROUP  NUMBERS 
FOR  FULL  VISIBILITY  RANGE  (30-6500  FEET) 

RVR  SUMMARY  FOR  FULL  TEST  PERIOD 
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4 . 6  Sensor  Data  Comparisons 

As  a  final  output,  the  SENSOR  program  provides  cumulative 
summaries  of  the  comparisons  of  each  of  the  sensors  with  the 
standard  (as  defined  in  the  previous  section)  transmissometer 
reading,  both  for  the  RVR  and  AWOS  ranges.  The  RVR  tables  are 
related  to  the  previous  analysis,  as  the  error  groups  used  are 
the  same.  The  previous  analysis  looked  at  the  number  in  each 
group  and  allowed  determination  of  whether  a  sensor  was  reading 
consistently  higher  or  lower  than  the  standard.  In  this 
analysis,  the  absolute  value  of  the  error  is  considered,  so  that 
equal  numbers  of  high  and  low  readings  are  not  balanced  out  to 
make  the  sensor  seem  more  accurate  than  it  is.  The  tables 
indicate  an  error  E  greater  than  16.5  percent,  25  percent,  35 
percent,  and  2X.  As  explained  previously  (see  Section  3.6)  these 
four  groups  are  actually  -16.5%  <E  <+16.5%;  -20%  <E  <+25%; 
-25%  <  E  <  +35%;  and  -100%  <  E  <  +100%. 

The  data  from  the  final  cumulative  summary  for  the  HSSl 
sensor  (for  time  period  15)  containing  error  groups  as  a  function 
of  sigma  range  for  each  sensor  compared  to  the  standard  transmis¬ 
someter  readings  has  been  summarized  in  Table  4-17.  The  complete 
set  of  eight  tables  is  given  in  Appendix  M.  Only  the  ten 
significant  weather  conditions  used  in  the  previous  analyses  have 
been  included.  The  final  four  columns  in  each  table  convert  the 
error  groups  from  number  with  error  greater  than  the  limit  to 
percent  with  error  less  than  the  limit.  As  an  example,  sensor 
HSSl  shows  that  a  total  (overall  sigma  range)  of  5639  out  of 
13406  samples  lie  within  25  percent  of  the  standard  reading. 

Thit,  translates  to: 


13406-5639 

13406 


x  100  =  57.9% 


of  the  sensor  readings  with  an  error  of  less  than  25  percent  of 
the  standard  readings. 
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TABLE  4-17.  COMPARISON  OF  HSS1  SENSOR  WITH  AVERAGE  OF  TRANSMISSOMETER  READINGS 

(RVR  Summary  for  Full  Test  Period) 


For  ease  in  comparison,  the  percentages  for  the  total  RVR 
range  of  extinction  coefficients  (1.5-38  km-1  or  6500-250  feet 
visibility)  have  been  extracted  from  the  eight  tables  and 
rearranged  to  present  data  for  all  eiqht  sensors  under  each 
weather  condition.  This  information  is  presented  in  Tables  4-18. 
Note  that  the  final  "all-weather"  table  provides  convenient 
overall  f igures-of-mer i t  for  the  sensors.  However,  these  should 
be  used  with  care,  as  this  analysis  does  not  cover  all  phases  of 
the  comparison. 


To  help  visualize  the  information  on  these  tables,  a 
series  of  bar  charts  has  been  used  to  present  the  data 
graphically.  The  meaning  of  the  bars  and  the  percentages 
involved  has  been  explained  further  on  Figure  4-8.  The  data 
comparison  presented  in  Figures  4-9  shows  the  effect  of  weather 
conditions  and  extinction  coefficient  group  for  each  sensor,  and 
correspond  directly  to  the  information  in  Table  4-17.  The  final 
composite  data  from  Table  4-18  is  presented  in  Figure  4-10. 

A  similar  analysis  is  done  by  SENSOR  for  the  AWOS  range. 
Here  the  errors  are  expressed  in  terms  of  reporting  increments 
(RI) ,  as  is  standard  custom,  rather  than  in  percentages.  The 
reporting  increments  are  described  in  Section  3.6.  Just  as  for 
the  RVR  range.  Table  4-19  summarizes  the  data  for  the  HSSl  sensor 
for  AWOS  from  the  final  cumulative  summary  showing  error  groups 
as  a  function  of  sigma  range  for  each  sensor  compared  to  the 
standard  (1000-foot  baseline)  transmissometer  readings.  The 
complete  set  of  eight  tables  is  given  in  Appendix  N.  These  are 
also  shown  graphically  in  Figures  4-11.  Finally,  the  percentages 
for  the  total  AWOS  range  of  extinction  coefficients  of  0.2-9. 6  km 
~i  (9.0-0.19  miles  visibility)  have  been  extracted  and  combined 
into  Table  4-20,  which  presents  data  for  all  eight  sensors  under 
each  of  the  ten  weather  conditions  studied.  Figure  4-12  is  a 
graphical  presentation  of  the  information  in  these  tables.  Refer 
to  Figure  4-8  for  an  explanation  of  the  symbols  used  on  the  bar 
charts . 


TABLE  4-18.  COMPARISON  OF  SENSORS  WITH  AVERAGE  OF  TRANSMISSOMETER 
READINGS  FOR  FULL  VISIBILITY  RANGE  (250-6500  FEET) 

( RVR  Summary  for  Full  Test  Period) 
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PERCENT  WITHIN  ERROR  LIMIT 


RVR RANGE 


AWOS  RANGE 


NOTES:  1)  Any  portion  of  the  column  may  be  missing,  depending  on  the  data 

2)  The  column  is  totally  blank  when  all  readings  agree  within  the  lowest  limit  (16.5%  or  1  Rl) 

3)  NONE  indicates  no  reading  in  that  column. 


FIGURE  4-8.  DESCRIPTION  OF  SENSOR  COMPARISON  CHARTS 


FIGURE  4-9.  ERROR  RANGE  ANALYSIS  FOR  RVR  RANGE  (Cont 
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FIGURE  4-9.  ERROR  RANGE  ANALYSIS  FOR  RVR  RANGE  (Cont . 


FIGURE  4-9.  ERROR  RANGE  ANALYSIS  FOR  RVR  RANGE  (Cont . ) 


FIGURE  4-9.  ERROR  RANGE  ANALYSIS  FOR  RVR  RANGE  (Cont 


FIGURE  4-9.  ERROR  RANGE  ANALYSIS  FOR  RVR  RANGE  (Cont. 


COMPARISON  OF  SENSORS 


FIGURE  4-10.  ERROR  RANGE  ANALYSIS  SUMMED  OVER  SIGMA,  FOR  RVR  RANGE 


COMPARISON  OF  SENSORS 
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FIGURE  4-10.  ERROR  RANGE  ANALYSIS  SUMMED  OVER  SIGMA,  FOR  RVR  RANGE  (Cont . 


TABLE  4-19.  COMPARISON  OF  HSSl  SENSOR  WITH  lOOO-FOOT  TRANSMISSOMETER  READINGS 

(AWOS  Summary  for  Full  Test  Period) 
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FIGURE  4  11.  ERROR  RANGE  ANALYSIS  FOR  AWOS  RANGE  (Cont 


FIGURE  4-11.  ERROR  RANGE  ANALYSIS  FOR  AWOS  RANGE  (Cont . 
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FIGURE  4-11.  ERROR  RANGE  ANALYSIS  FOR  AWOS  RANGE  (Cont. 
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FIGURE  4-11.  ERROR  RANGE  ANALYSIS  FOR  AWOS  RANGE  (Cont. 


FIGURE  4-12.  ERROR  RANGE  ANALYSIS  SUMMED  OVER  SIGMA  (Cont. 


The  foregoing  analysis  showed  a  surprisingly  high 
percentage  of  the  data  to  lie  in  the  largest  error  ranges,  >100 
percent  variation  from  the  standard  transmissometer  for  the  RVR 
range,  or  >4  Reporting  Increments  for  the  AWOS  range.  To 
investigate  this  further,  the  >2X  error  cases  for  the  RVR  range 
of  the  X-l,  X-2,  HSSl,  HSS2  and  HSSA  sensors  were  studied.  These 
were  all  cases  in  which  the  300-foot  and  500-foot 
transmissometers  agreed  to  within  10  percent,  but  the  FSM  reading 
was  less  than  half  or  more  than  twice  the  average  of  the  two 
transmissometer  readings. 

The  breakdown  of  these  hours  by  time  periods  and  sigma 
ranges  is  shown  in  Tables  0-1  in  Appendix  0.  Table  4-21 
summarizes  the  percentage  of  the  data  which  was  in  the > 2X  range 
for  each  of  the  five  sensors,  and  the  percentage  of  these  hours 
that  occurred  during  pure  snow  or  snow  and  fog  weather 
conditions.  For  the  EG&G  sensors,  the  majority  of  these 
discrepancies  were  under  snowy  conditions.  These  sensors  have 
been  known  to  respond  poorly  in  snow.  However,  it  is  evident 
that  the  HSS  sensors,  and  even  the  transmissometers,  are  subject 
to  errors  in  this  type  of  weather.  Figure  0-1  is  a  strip  chart 
covering  a  period  during  one  of  these  storms  involving  blowing 
snow,  showing  the  effect  of  the  buildup  of  snow  and  ice  in  the 
sensors.  The  FG50  sensor  was  inoperative  during  the  entire 
period.  Figures  0-2  show  scatter  plots  covering  a  period  near 
the  start  of  this  storm,  when  some  of  the  sensors  had  been 
affected.  Figures  0-3  show  further  deterioration  in  the  sensor 
responses  several  hours  later. 

Although  the  HSS  sensors  were  affected  by  snowy  condi¬ 
tions,  more  occurrences  of  > 2X  error  corresponded  to  conditions  of 
rain,  fog,  or  rain  &  fog.  These  weather  conditions  account  for 
61.4,  60.3  and  57.7  percent  of  the  >  2X  error  hours  for  the  HSSl, 


TABLE  4-21.  LARGE  DISCREPANCIES  IN  SENSOR  DATA 


Sensor 

Total 

Number  of 

Data  Hours* 

Error 

>  2X 

Snow  or 

Snow  &  Foq 

Number 

of  Hours 

Percent  of 

Total  Hours 

Number 

of  Hours 

Percent  of 

Error  Hours 

X-l 

260 

22,436 

1.16 

225 

86.5 

X-2 

363 

23,393 

1.62 

215 

59.2 

HSSl 

490 

22,294 

2.20 

129 

26.3 

HSS2 

907 

22,522 

4.03 

215 

23.9 

HSSA 

589 

18,859 

3.12 

211 

35.8 

♦Transmissometers  agree  within  +  10% 

HSS2  and  HSSA  sensors,  respectively.  Scatter  plots  were  made  for 
representative  periods  which  contained  large  groups  of  hours  in 
the  high  error  range. 

One  of  the  representative  incidents  is  shown  in  the  strip 
chart  of  Figure  0-4  (see  Appendix  0)  and  the  scatter  plots  of 
Figures  0-5.  Note  that  sensors  F15A  and  FG50  are  inoperative 
throughout  the  incident  and  that  the  Y  sensor,  which  clearly 
reads  too  high  at  the  start  of  the  strip  chart,  appears  to  settle 
back  and  behave  properly  thereafter.  The  HSSA  sensor  appears  to 
have  undergone  a  shift  in  calibration  and  reads  high  throughout 
the  incident.  Many  of  the  occurrences  of  high  error  range  for 
the  HSS  sensors  are  of  this  type,  an  unexplained  calibration 
change  which  is  not  sufficient  to  show  clear  signs  of  failure. 


A  third  type  of  incident  which  resulted  in  large  error 
readings  is  due  to  failure  to  recognize  when  a  sensor  was  not 
operating  properly,  and  hence  not  including  it  in  the  failure 
file,  which  would  have  dropped  the  point  from  the  statistics.  An 
example  is  the  failure  of  the  X-l  sensor  shown  in  the  strip  chart 
of  Figure  0-6  and  the  scatter  plots  of  Figures  0-7  (see  Appendix 
0) .  In  this  particular  case,  the  sensor  was  replaced  about  two 
weeks  after  this  incident. 

Another  type  of  incident  which  appears  to  cause  some  of 
the  large  discrepancies  in  the  ratio  between  the  FSMs  and  the 
transmissometer  was  due  to  saturation  of  the  transmissometer . 

This  occurred  under  what  was  apparently  locally  heavy  fog 
conditions,  although  the  weather  service  reported  no  lower  than 
three  miles  visibility.  Saturation  of  the  transmissometers  was 
not  considered  a  failure  to  be  reported  in  the  failure  file. 
However,  the  FSMs  are  generally  able  to  remain  linear  under  much 
more  dense  conditions  than  the  transmissometer,  hence  the  ratios 
show  large  FSM/transmissometer  values.  The  incident  shown  in  the 
strip  chart  of  Figure  0-8  (see  Appendix  0)  is  a  good  example, 
showing  clear  saturation  of  the  T000  (1000-foot  baseline)  and 
T500  transmissometers,  and  a  period  when  the  T300  and  the  EG&G 
sensors  also  appear  to  be  saturated.  Data  should  have  been 
excluded  from  the  statistics  by  the  SENSOR  program  when  the  T500 
was  saturated  and  the  T300  was  not.  The  HSS2,  F15A  and  FG50  are 
inoperative  during  the  period.  The  scatter  plots  of  Figures  0-9 
clearly  show  the  T500  saturation. 


In  summary,  most  of  the  occurrences  of  >100  percent 
difference  between  an  FSM  sensor  and  the  500-foot  transmissometer 
fall  into  one  of  the  following  categories: 

(1)  Snowy  conditions,  where  none  of  the  sensors  behave 
well; 

(2)  Saturation  of  the  transmissometer,  which  should  have 
been  excluded  in  the  SENSOR  program; 

(3)  A  failed  sensor  which  was  not  identified  as  such;  or 

(4)  Unexpected  calibration  shifts  in  a  sensor,  which 
either  correct  themselves  or  lead  towards  failure  of 


the  instrument. 


5.  SUMMARY 


5 . 1  Philosophy 

The  science  of  visibility  has  a  long  history  because  of 
the  very  complex  issues  involved.  The  perceived  visibility 
depends  upon  four  independent  factors: 

1.  The  object  being  viewed, 

2.  The  observer, 

3.  The  atmosphere,  and 

4.  The  lighting. 

Because  of  these  many  variables,  the  visibility  is  not 
precisely  defined.  Measurements  of  visibility  are  made  by  making 
reasonable  assessments  of  the  four  factors.  Visibility  sensors 
deal  only  with  the  third  item,  the  atmosphere,  which  is  charac¬ 
terized  by  a  single  parameter,  the  extinction  coefficient.  The 
other  variables  are  handled  by  using  standard  equations  based  on 
visibility  research.  For  example,  runway  visual  range  (RVR)  is 
specified  by  the  human  detection  thresholds  for  lights  and  con¬ 
trast  (factor  2) ,  the  runway  light  setting  (factor  1)  and  the 
background  luminance  level  (day  or  night)  (factor  4) .  The 
extinction  coefficient  measured  by  a  single  sensor  is  used  to 
characterize  the  atmosphere  within  about  2000  feet  of  the  sensor. 


The  accuracy  of  a  visibility  measurement  in  predicting 
what  an  observer  will  experience  thus  depends  upon  the  following 
variables : 


1.  Spatial  variations  in  the  extinction  coefficient. 

2.  Variations  in  the  observer. 

3.  Errors  in  defining  the  lighting. 

4.  Errors  of  the  visibility  sensor. 

In  this  context,  the  accuracy  required  for  a  visibility 
sensor  need  be  only  enough  that  sensor  errors  not  accentuate  the 
errors  from  other  sources.  For  example,  a  typical  rms  spatial 
variation  for  fog  at  2000  feet  separation  is  about  +30  percent 
(see  Appendix  P) .  It  is  important  not  to  confuse  the  reporting 
precision  of  a  visibility  measurement  with  the  required  accuracy. 
The  customary  reporting  resolution  for  visibility  is  often  much 
finer  than  warranted  by  either  the  precision  of  the  visibility 
estimate  or  the  accuracy  of  existing  sensors. 

The  evaluation  of  visibility  sensors  is  plagued  by  an 
issue  closely  related  to  the  imprecision  in  the  definition  of 
visibility.  What  can  be  used  as  a  visibility  standard?  Human 
observations  are  too  variable  to  be  used  as  a  standard. 

Reference  1  showed  a  +50  percent  variation  in  comparisons  of 
visibility  sensors  to  human  observations.  Much  closer  agreement 
is  usually  shown  in  comparisons  between  different  visibility 
sensors.  The  selection  of  Tasker  RVR  500  transmissometers  as  the 
standard  sensors  for  the  current  study  was  somewhat  arbitrary, 
but  was  based  on  the  following  criteria: 

1.  A  transmissometer  is  self  calibrating. 

2.  The  Tasker  Model  RVR  500  is  the  current  U.S. 
visibility  sensor. 


— WHiWiWHMIi  *  j<m»^  iMt  -Mnanwtmsff 


There  are  two  considerations  that  limit  the  usefulness  of 
this  standard.  First,  the  light  spectrum  used  in  the  RVR  500 
includes  a  considerable  amount  of  infrared  light.  When  the  RVR 
500  is  compared  with  transmissometers  from  other  countries,  which 
use  different  light  sources,  significant  differences  are  noted. 

A  Japanese  transmissometer  that  uses  infrared  light  emitting 
diodes  gives  extinction  coefficients  about  23  percent  lower.  On 
the  other  hand,  a  German  transmissometer  using  a  Xenon  flashlamp 
gives  extinction  coefficients  about  12  percent  higher.  Although 
the  German  transmissometer  uses  a  light  spectrum  closer  to  the 
response  of  the  human  eye,  all  three  instruments  are  accepted  as 
valid  visibility  instruments  in  their  own  countries.  It  is 
evident  that  the  observed  variations  in  transmissometer  response 
are  within  the  acceptable  range  for  aviation  visibility 
measurements . 

The  second  difficulty  in  using  the  RVR  500  as  a  standard 
is  the  difficulty  in  getting  two  transmissometers  to  agree,  as 
discussed  in  Section  4.4.  Much  of  the  disagreement  is  due  to 
spatial  variations  in  the  extinction  coefficient.  In  addition, 
the  300-  and  500-foot  transmissometers  show  a  consistent 
systematic  disagreement  of  about  8  percent.  In  light  of  the 
observed  disagreements  between  two  transmissometers,  it  is  not 
surprising  that  perfect  agreement  is  not  obtained  between  a 
transmissometer  and  a  forward  scatter  meter. 

5.2  Sensor  Performance 


A  total  of  60  incidents  of  low  visibility  were  chosen  by 
investigating  both  the  weather  information  from  the  site  and 
strip  charts  of  extinction  coefficients  as  a  function  of  time. 
The  incidents  included  various  types  of  weather  conditions,  but 
most  of  them  contained  at  least  some  fog,  which  was  the  weather 
condition  most  responsible  for  reduced  visibility.  Complete 
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strip  charts  were  run  for  all  60  incidents,  and  scatter  plots 
were  produced  to  compare  the  response  of  each  of  the  sensors  to  a 
standard  transmissometer .  The  time  variations  in  the  slopes  of 
the  scatter  plots  were  investigated,  both  on  a  short  term  and  on 
a  long  term  basis,  in  Sections  4.2  and  4.3  respectively.  The 
scatter  in  the  slopes  was  more  extensive  than  expected,  but  most 
of  the  outlying  points  were  explained  in  terms  of  instrument 
failure  or  differences  in  the  type  of  fog.  No  evidence  of 
calibration  drift  was  obtained  from  these  plots. 

A  comprehensive  statistical  analysis  of  the  data  was 
performed  with  the  program  SENSOR.  As  a  first  step,  the  program 
identified  all  cases  where  the  300-foot  and  500-foot  baseline 
transmissometers  disagreed  by  at  least  10  percent.  These  cases 
are  properly  excluded  from  the  statistical  analysis,  since  most 
of  them  signify  spatial  variations  in  the  atmospheric  conditions 
sufficient  that  the  forward  scatter  meter  would  not  be  expected 
to  measure  the  same  conditions  as  the  transmissometer.  As 
indicated  in  Section  4.4,  a  significant  fraction  of  the  data  was 
excluded  in  this  manner. 

For  each  sensor,  the  SENSOR  program  produced  tables  of 
sigma  values  as  a  function  of  time,  weather  conditions,  and  sigma 
range.  To  provide  for  more  convenient  comparison  of  the  effec¬ 
tiveness  of  the  sensors,  the  analysis  of  Sections  4.5  and  4.6 
integrated  out  each  of  the  variables  in  turn.  First,  only  the 
overall  sigma  range  was  considered,  so  that  the  sigma  values  for 
each  sensor  were  a  function  of  time  and  weather  conditions. 

Next,  only  the  full  test  period  was  considered,  so  that  the  sigma 
values  for  each  sensor  were  presented  as  a  function  of  the 
weather  conditions  only.  Finally,  the  all-weather  table  provides 
convenient  f igures-of-mer it  for  comparison  of  the  sensors. 


Data  is  presented  for  the  RVR  range  in  terms  of  the  ratio 
of  sensor  sigma  to  transmissometer  sigma.  Nine  ratio  groups  were 
identified,  with  ratios  of  <  0.5,  0.5-0.75,  0.75-0.8,  0.8-0.835, 
0.835-1.165,  1.165-1.25,  1.25-1.35,  1.35-2.0,  and  >2.0,  and 
numbered  1  through  9  respectively.  The  middle  group  contains  all 
data  where  the  FSM  and  transmissometer  agree  within  16.5  percent. 
One  f igure-of-mer it  is  the  average  group  number,  obtained  by 
weighting  each  group  number  with  the  number  of  cases  in  the 
group.  The  results  are  shown  in  Table  5-1. 

Comparison  of  the  number  of  cases  for  each  sensor  is  a 
good  indicator  of  the  fraction  of  the  test  period  that  the  sensor 
was  in  operation.  The  best  sensor  from  Table  5-1  is  the  FG50, 
followed  by  the  HSS2  and  X-l  sensors,  however,  the  FG50  was  out 
of  operation  for  a  considerable  period.  This  analysis  can  be 
misleading,  however,  because  a  "perfect"  5.0  can  be  obtained  by 
half  of  the  readings  in  group  1  and  half  in  group  9,  as  well  as 
all  of  the  readings  in  group  5.  The  final  comparison  took  this 
into  account  by  considering  percentage  discrepancies  between  the 
FSM  and  transmissometer  for  the  RVR  range,  and  the  number  of 
reporting  increments  (see  below)  difference  for  the  AWOS  range. 
These  results,  for  all-weather  conditions,  are  presented  in 
Figure  5-1  and  5-2  for  the  RVR  and  AWOS  ranges  respectively. 

The  all-weather  data  comparison  is  most  convenient  for 
assessing  comparative  sensor  performance.  On  Figure  5-1  and  5-2, 
the  best  performance  is  indicated  by  the  maximum  percentage 
within  the  lower  unshaded  section  and  the  minimum  percentage 
within  the  upper  unshaded  area.  For  the  RVR  range,  on  Figure  5- 
1,  the  EG&G  sensor  labeled  X-l  performed  best  from  both  points  of 
view.  It  had  the  smallest  percent  of  f actor-of-two  errors  (1.2%) 
and  the  greatest  percent  with  less  than  16.5  percent  error 
(72.4%).  The  next  best  performers  considering  the  f actor-of-two 


errors  were 


TABLE  5-i .  AVERAGE  GROUP  NUMBERS  FOR  RVR  RANGE 


ensor 

Number  of 

Average 

Name 

Cases 

Group  Number 

HSS1 

22,294 

5.72 

HSS2 

22,522 

5.11 

HSSA 

18,858 

5.30 

F15A 

13,235 

4.15 

F15B 

22,021 

5.66 

FG50 

18,343 

5.07 

X-l 

22,436 

5.12 

X-2 

22,393 

5.42 

the  X-2  and  HSS1  sensors,  with  1.7  percent  and  2.3  percent, 
respectively.  On  the  other  hand,  the  FG50,  F15A  and  X-2  sensors 
had  the  next  best  percentages  of  data  in  group  5,  with  63.3 
percent,  62.9  percent  and  61.4  percent,  respectively. 

For  the  AWOS  sensors,  data  was  reported  in  terms  of  the 
number  of  reporting  increments  by  which  the  FSM  and  transmisso- 
meter  disagreed.  Reporting  increments,  which  are  more  fully 
explained  in  Table  3-3,  are  a  series  of  18  visibility  ranges  in 
miles,  denoted  by  the  labels  <  0.25,  0.25,  0.5,  0.75,  1.0,  1.25, 
1.5,  1.75,  2.0,  2.5,  3.0,  3.5,  4.0,  5.0,  6.0,  7.0,  8.0,  and  >8.0 
miles.  For  the  AWOS  range,  on  Figure  5-2,  the  X-2  sensor  has  the 
minimum  percentage  of  data  with  more  than  four  reporting 
increment  error,  2.0  percent,  followed  by  the  HSS2,  FG50  and  X-l 
sensors,  with  3.7  percent,  3.8  percent  and  3.9  percent 
respectively.  The  FG50  sensor  has  the  maximum  percentage  of  data 
within  one  reporting  increment,  60.1  percent,  followed  by  the 
HSS2  and  F15A  sensors  with  59.5  percent  and  58.6  percent 
respectively. 


FIGURE  5-1.  RVR  RANGE  COMPARISON  OF  SENSORS  (ALL  WEATHER  CONDITIONS) 
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FIGURE  5-2.  AWOS  RANGE  COMPARISON  OF  SENSORS  (ALL  WEATHER  CONDITIONS) 


5.3 


Conclusions 


Data  was  collected  at  Otis  ANGB  on  the  USAF/AFGL  sensors 
during  the  period  between  1/5/84  and  5/2/85.  With  several  miss¬ 
ing  weeks  of  data,  there  was  a  total  of  60  weeks  of  data  used  in 
this  analysis.  The  following  general  observations  can  be  made: 

1.  Most  of  the  episodes  showed  variations  of  less  than 
15  percent  in  the  slope  of  the  scatter  plots  of 
forward  scatter  meter  versus  the  T500 
transmissometer .  Of  those  events  showing  greater 
than  15  percent  slope  variations  for  the  two  EG&G 
sensors  under  fog  conditions,  half  could  be 
explained  by  inhomogeneous  fog  or  sensor  failure. 
Most  of  the  rest  had  low  extinction  coefficients, 
where  the  overall  slope  was  influenced  by  the  higher 
"haze"  slope  of  the  forward  scatter  meter.  Finally, 
two  of  the  slope  variations  (both  less  than  20%)  had 
no  explanation  other  than  a  dependence  on  the  type 
of  fog  or  a  temporary  calibration  shift.  Thus 
forward  scatter  meters  can  give  a  consistent 
response  to  fog  with  maximum  variations  of  no  more 
than  20  percent. 

2.  Study  of  the  agreement  among  two  crossed  transmisso- 
meters  showed  that  a  surprisingly  large  fraction  of 
the  readings  did  not  agree  within  10  percent, 
despite  the  fact  that  the  transmissometers  underwent 
normal  maintenance  and  were  recalibrated  daily  using 
FSM  data.  Only  68  percent  of  the  data  was  in 
agreement  on  an  overall  basis  (all  sigmas  and 
weather  conditions)  for  the  RVR  range.  This  was 
reduced  to  45  percent  agreement  for  the  AWOS  range. 
It  is  considered  unlikely  that  this  is  a  true 


measure  of  the  variability  of  the  atmosphere  over 
the  test  site,  since  transmissometer  errors  appear 
to  be  making  a  significant  contribution. 

Statistics  of  the  comparison  of  signas  from  each  of 
the  sensors  compared  to  the  standard  transmissometer 
showed  a  large  dependence  upon  the  weather  condi¬ 
tions  and  the  extinction  coefficient  range.  Most  of 
the  results  did  lie  within  the  16.5  percent  (RVR)  or 
one  reporting  increment  (AWOS)  limits.  The  best 
sensor,  the  EG&G  X-l  sensor,  showed  72  percent  of 
the  RVR  measurements  within  +16.5  percent  agreement. 
A  surprisingly  large  number  of  measurements  exceeded 
the  100  percent  or  four  reporting  increment  limits. 
These  serious  errors  were  mostly  caused  by 
undetected  sensor  failures,  including  such  problems 
as  being  clogged  with  snow. 

The  best  forward  scatter  meter  appears  to  do  a 
reasonable  job  of  monitoring  the  visibility  varia¬ 
tions  of  the  atmosphere.  One  proposed  acceptance 
criterion  required  that  90  percent  of  the  RVR 
measurements  agree  with  a  transmissometer  to  within 
+16.5  percent.  This  level  of  agreement  was  not 
achieved.  In  view  of  the  limited  agreement  of  two 
transmissometer s  operating  under  the  same  condi¬ 
tions,  it  could  be  argued  that  this  criterion  ex¬ 
pected  too  much  from  the  FSMs.  That  the  extinction 
coefficients  derived  from  the  scatter  meters  do  not 
always  agree  with  those  from  the  transmissometer s 
does  not  rule  out  their  use  in  this  regard.  Agree¬ 
ment  is  definitely  better  as  the  visibility  is 
reduced,  which  indicates  that  the  FSMs  work  best 
when  they  are  most  needed.  Perhaps  a  more  meaning¬ 
ful  way  to  show  FSM  acceptibility  would  be  to  deter- 


mine  how  often  decisions  regarding  landing  condi¬ 
tions  would  be  different  using  the  FSM  rather  than 
the  transmissometer . 

Although  the  EG&G  Model  207  visibility  sensor  gave 
the  best  performance  in  this  evaluation,  it  cannot 
be  considered  for  operational  deployment  because  of 
its  unreliability.  Moreover,  it  is  no  longer  in 
production.  The  large  scattering  volume  of  the  EG&G 
Model  207  appears  to  contribute  to  the  stability  of 
its  response.  The  HSS  sensors,  which  are  much  more 
reliable  because  they  have  no  moving  parts  or 
incandescent  light  bulbs,  have  a  small  scattering 
volume  and  give  more  erratic  measurements.  Perhaps 
the  ideal  sensor  would  be  of  the  HSS  type  with  a 
larger  scattering  volume. 
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